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ABSTRACT 


This  thesis  is  concerned  with  the  analysis  of  a  class  of  non¬ 
linear  systems  with  random  inputs.  The  nonlinear  feedback  system  is 
considered  to  be  a  perturbed  version  of  a  linear,  time  invariant  feed¬ 
back  system  whose  open  loop  transfer  function  has  poles  only  in  the 
left  half  plane. 

A  functional  analysis  approach  involving  the  use  of  random 
contraction  mapping  and  the  fixed  point  principle  is  considered,  while 
restricting  the  input  to  the  class  of  stationary,  ergodic  and  Gaussian 
stochastic  processes. 

An  analysis  of  a  first  order  phase  locked  loop  system  is  pre¬ 
sented  utilizing  the  above  approach  and  the  Volterra  series  expansion 
technique. 

A  comparison  of  the  results  with  those  obtained  by  other  per¬ 
turbation  techniques  indicates  this  approach  to  be  a  more  realistic 
one  near  the  threshold  region.  The  proposed  method  is  general  in 
nature  and  can  be  extended  to  cases  where  a  low  pass  filter  is  included 
in  the  phase  lock  loop. 
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1.  We  want  to  show  that  the  condition  (given  on  page  28) 

j|x(t)|j  =  lim  — | x(t) | dt 

2T_rp 

implies  | |xj  |  *  0  if  and  only  if  x  =  0. 

The  space  of  random  variables  with  finite  first  order  absolute 

i  l  i  l  i  !  ,  |  22 

moment,  E  |£|  <  00  is  a  Banach  space  with  | | £ | |  =  E  | £ | .  In  the  case 

o 

of  strictly  stationary  ergodic  processes,  according  to  Doob  (p.  516), 
we  have 

i  T 

lim  — i-/  x  (03)dt  =  E(x0). 

T-*=o  Zi_T 

Since  {xt)  being  a  strictly  stationary  process  implies  { j xfc j }  is  also 

a  strictly  stationary  process,  we  have 

lim  T^/+T  |  xt  (U3)  |  dt  =  E  (  |  xQ  |  )  . 

X-x>o  ^ 1  — T 

Thus  j  | x |  j  =  0  implies  E ( j  x  j )  =  0  and  this  can  happen  only  if  xQ  =  0. 

« 

Now  utilising  the  property  of  strict  stationarity , 

E  | x0 |  =  E  jxt|  =0  for  all  t. 

Hence  |  j  x  j  j  =  0  implies  x  =  0  (almost  everywhere)  for  all  t.  Also  if 
x  =  0,  then  j  j x ( t ) |  |  =  0. 

2.  We  make  the  assumption  on  pages  31  and  32  that  |  j  xy  j  j  <;  j  |xj  I  j  jy| 
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CHAPTER  I 


INTRODUCTION 


The  designer  of  control  systems  invariably  has  to  deal  with 
nonlinear  phenomena.  Only  over  a  limited  range  can  linear  relations 
describe  the  real  elements  of  such  a  system.  The  dynamic  properties 
of  control  systems  can  be  considerably  improved  by  the  introduction 
of  nonlinear  techniques.  Similarly,  adaptive  optimal  systems  point  up 
the  significance  of  nonlinear  relations.  Statistical  methods  of  design 
are  coming  increasingly  into  use  because  one  can  construct  and  study 
systems  which  successfully  combat  interference  and  which  work  reason¬ 
ably  well,  not  only  for  several  common  fixed  signals,  but  for  a  whole 
spectrum  of  possible  situations  that  may  arise  in  real  conditions. 

In  the  analysis  or  synthesis  of  nonlinear  systems,  just  as  in 
linear  systems,  the  first  problem  one  encounters  is  how  to  characterize 
the  systems.  One  possible  way  to  describe  nonlinear  systems  is  by  non¬ 
linear  differential  equations.  But  the  equation  only  gives  an  implicit 
relationship  between  the  input  and  output.  The  other  classical  techni¬ 
ques  of  treating  nonlinear  problems  are  the  phase  plane  method  and  the 
describing  function  method.  The  phase  plane  method  can  only  treat 
second  order  equations  effectively.  The  describing  function  method  is 
only  useful  to  determine  the  sinusoidal  steady  state  solution  for  the 
systems  in  which  the  first  harmonic  is  the  only  significant  term.  Re¬ 
cently,  stability  theory  based  on  Liapunov's  second  method  has  also 
been  applied  to  the  analysis  and  synthesis  of  nonlinear  control  sys¬ 
tems'*'. 
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2. 


A  new  approach  to  the  description  of  a  system  is  through  the 

concept  of  a  functional  series.  The  transfer  function  concept  plays 

an  important  role  in  the  analysis  and  synthesis  of  linear  systems. 

The  Volterra  series  is  the  generalization  of  this  concept  of  nonlinear 
2 

systems  .  This  representation  leads  to  an  explicit  input-output  rela¬ 
tion  for  nonlinear  systems  described  by  differential  equations  with  a 
forcing  term.  The  relation  consists  of  an  infinite  series  composed  of 
terms  of  the  form  of  convolution  integrals.  The  first  order  kernel  is 
the  impulse  response  of  the  linear  portion  of  the  nonlinear  differenti- 
al  equation  of  the  system.  The  nL  1  order  term  may  be  considered  as  an 
n-fold  convolution  containing  the  n1"  order  kernel  multiplied  by  an  nL 
order  product  of  the  forcing  term. 

1-1  Statistical  Models  of  Nonlinear  Systems  With  Random  Inputs 

Consider  the  nonlinear  automatic  control  system  whose  block 
diagram  is  shown  in  Fig.  1.1. 
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In  general,  both  the  control  plant  P  and  the  controller  C  are  describ¬ 
ed  by  nonlinear  operators  with  memory.  An  arbitrary  random  signal  y(t) 
with  known  statistical  properties  acts  on  the  system  as  the  input. 

The  problem  is  to  determine  statistical  characteristics  of  the  system 
output  x(t)  with  specified  C  and  P.  At  present,  three  methods  of  solv- 

O 

ing  the  analysis  problem  exist  . 

(a)  Functional  Series  Approach 

The  mathematical  basis  consists  of  representing  the  solution  of 
the  nonlinear  system  as  a  functional  series.  The  nonlinear  functional 
is  expanded  into  an  orthogonal  series  in  a  selected  system  of  orthogo¬ 
nal  polynomial  functions^.  The  analysis  problem  is  reduced  to  determi¬ 
ning  the  parameters  of  the  representation.  This  can  be  done  by  com¬ 
puting  the  cross-correlations  of  the  outputs  of  the  actual  nonlinear 
operator  and  of  the  model  when  signals  of  the  "white  noise"  type  act 
on  them.  It  is  possible  to  construct  an  exact  model  of  the  arbitrary 
nonlinear  operator  but  it  is  extremely  laborious. 

(b)  Method  of  Constructing  a  Markov  Model  of  the  Nonlinear  System 

The  response  of  any  dynamic  system  can  be  represented  by  a 
point  in  the  phase  space.  With  increasing  time,  the  representative 
point  describes  a  phase  trajectory  which  represents  the  history  of  the 
dynamical  system.  If  the  input  to  the  system  is  a  random  function  of 
time,  the  representative  point  undergoes  a  random  motion.  The  trajec¬ 
tory  in  the  phase  space  can  be  considered  a  Markov  process.  The  proba¬ 
bility  distributions  associated  with  the  process  can  be  determined  by 
using  Kolmogarov  or  Fokker-Planck  equations^.  In  practice,  however, 
numerical  results  can  be  obtained  with  relative  ease  only  for  the 
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4. 


systems  described  by  the  first  or  second  order  differential  equations, 
(c)  Method  of  Statistical  Linearisation 

The  nonlinear  system  is  approximated  by  its  linear  statistical 
equivalent  .  This  method  has  been  applied  with  a  degree  of  success  to 
open  loop,  zero  memory  nonlinear  systems.  Its  application  to  closed 
loop  system  analysis  is  in  general  limited  to  the  case  in  which  the 
plant  P  is  a  linear  system  and  controller  C  is  a  zero  memory  nonlinear 
function. 

The  impetus  to  the  first  method  of  analysis  was  given  by  the 
work  of  Wiener^.  Its  subsequent  development  and  application  have  been 
documented  in  the  monograph  of  Smith?.  The  present  analysis  employs  a 
functional-theoretical  approach  to  the  problem  rather  than  the  infinite 
series  Hermite  Laguerre  expansion  of  Wiener  et  al.  The  problem  is  re¬ 
stricted  to  a  stationary  Gaussian  ergodic  process  as  an  input  to  the 
nonlinear  feedback  system. 

The  second  chapter  gives  a  review  of  this  class  of  processes 
and  indicates  the  use  of  the  random  fixed  point  theorem  and  the  contra¬ 
ction  mapping  principle  in  the  analysis  of  the  problem.  In  the  next 
chapter,  a  specific  nonlinear  feedback  system  consisting  of  a  linear 
differential  operator  with  zeros  only  in  the  left  half  plane  and  a 
"square"  nonlinearity  in  the  feedback  loop  is  considered.  The  con¬ 
straints  on  the  input  and  the  output  are  developed  through  the  use  of 
the  contraction  mapping  principle.  The  fourth  chapter  deals  with  the 
analysis  of  phase-locked  loop  systems  which  are  of  great  importance  in 
modern  communication  and  space  technology.  Filially,  possible  exten¬ 
sions  of  the  approach  developed  in  the  thesis  are  considered  in  the 


last  chapter. 
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CHAPTER  II 


MATHEMATICAL  BACKGROUND  OF  STOCHASTIC  PROCESSES* 


2-1  Introduction 

The  word  stochastic  is  used  to  describe  processes  which  are 
based  on  chance.  The  theory  of  stochastic  processes  in  its  complete 
generality  requires  the  knowledge  of  the  multidimensional  probability 
distribution  functions  of  a  random  variable  and  is  usually  too  compli¬ 
cated  and  cumbersome  for  practical  use.  By  restricting  stochastic  pro¬ 
cesses  to  have  normal  probability  distribution  functions,  the  knowledge 
of  their  first  two  moments  is  sufficient  to  determine  all  subsequent 
moments.  The  theory  considering  only  the  first  two  moments  of  a  sto¬ 
chastic  process  is  often  refered  to  as  the  correlation  theory  of  the 
stochastic  processes.  If  the  first  two  moments  of  a  random  input  sig¬ 
nal  of  a  linear  dynamical  system  are  given,  then  one  can  always  find 

10 

the  first  two  moments  of  the  output  of  the  system  .  This,  however, 
does  not  apply  to  the  nonlinear  systems  where  it  is  necessary  to  know 
the  higher  moments  of  the  input  stochastic  signal. 

2-2  Mathematical  Description  of  a  Stochastic  Process 

(A)  Preliminary  Discussion  of  a  Random  Variable 

Consider  a  random  experiment  Z.  Let  A,B,...  denote  various 

8,9 


*  The  basic  material  covered  here  can  be  found  in  the  standard  texts 


' 


’ 


6 . 


observable  events  associated  with  Z.  Let  ft  denote  the  sure  event,  that 

is  an  event  which  always  occurs  when  Z  is  performed.  Let  (p  denote  an 

impossible  event,  an  event  which  never  occurs  as  an  outcome  of  Z.  Re- 
gard  both  ft  and  <j)  as  observable  events.  Let  A  denote  the  complemen¬ 
tary  event  of  A,  the  event  that  occurs  if  A  fails  to  occur.  Let  A  U  B 

be  the  event  that  at  least  A  or  B  occurs.  Let  A  O  B  be  the  event  that 

p 

both  A  and  B  occur.  Assume  that  A  ,  A  U  B,  A  0  B  are  observable 
when  A  and  B  are  observable.  Then  one  says  that  the  family  of  all  ob¬ 
servable  events  associated  with  Z  constitutes  a  field  FQ  of  events. 

Let  ft  be  a  space,  the  points  03  of  which  may  be  entities  of  any 
kind.  If  E  is  any  collection  of  03  sets,  there  is  always  a  smallest 
field  F0  including  all  the  sets  of  E.  A  field  F  of  03  sets  is  called  a 
Borel  field  or  a  a-field,  if  it  includes  all  countable  (finite  or  enu¬ 
merable)  unions  and  intersections  of  its  sets.  For  any  collection  E 
of  0)  sets,  there  is  always  a  smallest  Borel  field  including  E. 

Assume  that  to  every  event  A  in  the  field  FQ  there  corresponds 

a  definite  number  P (A)  called  the  probability  of  A  possessing  the  pro¬ 
perties  0  <  P(A)  <  1,  P(cj>)  =  0,  P(ft)  =  1  and  the  further  property  of 

OO 

countable  additivity:  when  A  =  th^jA^  where  A,  A^  e  FQ  and  Aj  (  \  A^  =  (j) 

when  j  /  k,  then  P(A)  =  7  P  (Aj_)  .  The  set  function  P(A)  is  then  a 

probability  measure  defined  on  the  sets  of  the  field  F0 . 

1  1 

Halmos  states  that  there  is  a  uniquely  determined  extension 
of  P (A)  to  a  probability  measure  defined  on  all  sets  A  of  the  smallest 
a-field  F  including  FQ .  A  final  extension  is  obtained  by  completing 
the  a-field  F  with  respect  to  the  measure  P.  This  completed  a-field 
has  the  property  that  if  it  includes  the  set  A  for  which  P(A)  =  0,  it 


also  includes  every  subset  of  A,  which  will  then  have  a  measure 
P(A^)  =  0.  The  extension  of  P  to  this  completed  a-field  is  still 
unique,  and  is  called  a  complete  probability  measure. 

A  space  £2  of  points  oo  with  a  a-field  F  of  sets  in  £2  and  a  pro¬ 
bability  measure  P  defined  on  F  constitutes  a  probability  space 
(£2,F,P).  The  sets  of  F  are  called  measureable  and  P  is  said  to  define 
a  probability  distribution  on  £2. 

Consider  a  function  E,  =  £(co)  defined  on  £2.  E,  is  said  to  be  a 

random  variable  or  measureable  with  respect  to  F,  if  it  is  a  real¬ 
valued  function  and  if,  for  every  real  number  A,  (to  e  £2;  ^ (to)  £  A}  £  F. 
If  E,  is  a  complex-valued  function,  E,  is  said  to  be  a  complex-random 
variable  if  its  real  and  imaginary  parts  are  random  variables.  Two 
random  variables  are  called  equivalent  if  they  differ  on  a  set  of  mea¬ 
sure  zero. 

For  a  random  variable  £,  the  function  G(A)  =  P{£(co)  £  A}  is 
defined  for  all  real  A  and  is  called  the  distribution  function  of 
It  is  monotone  non-decreasing,  continuous  on  the  right,  and 
lim  G(A)  =  0,  lim  G(A)  =  1. 

A+-co  A-*30 

If  G(A)  is  absolutely  continuous,  then  g(A)  =  G’ (A)  is  called  the  pro¬ 
bability  density  function  corresponding  to  the  distribution  function 
G(A) . 

Expectation  or  mean  value  of  a  function  f (O  of  the  random 
variable  E,  is  defined  as  the  Stieltjes  integral 

E  (f(£)}  =  /  f(OdP  =  ,/=K°f(x)dG(x) 

£2 

E  £n  is  the  nt^1  order  moment  of  E, 


■ 

r  £ 


■  • 
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E  E,  A  m  —  mean 

E  (E,  -  m)2  =  a2  —  variance,  where  O  is  called  the  standard  - 

deviation  of  E, 

If  E  {^}  <  °°,  then  E,  is  said  to  be  integrable. 


Normal  Distribution 


Let 


$(x)  =  ~p=  fXe  \  dy. 
/2m 


Then 


c()  (x)  =  $ '  (x) 


1  cT- 
e  2 


/2tt 


A  random  variable  E,  is  said  to  be  normal  (m,G)  if  it  has  the 

1  X  Til 

distribution  function  (d.f.)  0 (-■-■—)  and  the  density  function  —  cj)  ( - ) 

0  0  0 

The  distribution  is  symmetric  about  m  and 
E  (E,  -  m)n  -  0  for  n  odd 

=  1  0  3  •  *  •  (2k  -  1 )o2k  for  n  =  2k. 

(B)  Definition  of  Stochastic  Process  and  Related  Concepts 

Let  a  probability  space  (fi,F,P)  and  a  parameter  set  T  be  given. 

A  stochastic  process  is  then  defined  as  an  indexed  family  of  random 
variables  {^(t,U))},  which  for  each  fixed  t  £  T  is  a  measureable  func¬ 
tion  of  00  £  C!  and  for  each  fixed  00  £  El  is  an  ordinary  function  of 
t  e  T. 

for  a  fixed  a)  describes  the  development  (in  time,  space 
etc.)  of  the  process  and  is  a  particular  realisation  or  a  sample  function 
of  the  stochastic  process.  A  sample  function  can  be  regarded  as  a 
point  in  the  space  X  of  all  real  or  complex  valued  functions  x  of  the 


nsn  T 
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variable  t  £  T.  The  space  X  is  called  the  sample  (function)  space  of 
the  stochastic  process  (£(t,oo)}. 

The  process  (£(t,U))}  thus  determines  a  function  which  maps  the 
space  onto  a  certain  subspace  of  X  and  induces  a  probability  distri¬ 
bution  in  X.  A  set  A'  in  X  is  a  family  of  functions  of  t  on  T.  Every 
set  A’  £  X  has  as  its  inverse  image  a  certain  co  set 
A  =  {w  e  fi;  £(•  ,oo)  e  A’ }. 

The  family  of  such  sets  A’  whose  inverse  images  A  are  measureable 
sets  forms  a  (7-field  F' .  The  probability  measure  P'  thus  induced  on  X 
is  defined  for  all  sets  A'  £  F*  by  P’(A’)  =  P(A).  The  triple  (X,F’,P’) 
is  a  new  probability  space  corresponding  to  the  induced  measure  P'. 

We  may  regard  £  as  a  random  function,  taking  values  in  X  in  accordance 
with  the  probability  measure  P’. 

For  an  arbitrary  finite  set  of  t  values,  say  t1,...,tn,  the 
corresponding  random  variables  ^(t,),...,  (tn) ,  will  have  a  joint  n- 
dimensional  distribution  with  the  d.f. 

G  (x  i , .  .  .  ,  x^ ;  t  j , .  .  .  ,  t^)  =  P{(,(tj)  xi,.„.,£j(tn)  xxi^  * 

The  family  of  all  these  joint  probability  distributions  for  n  =  1,2,... 
and  all  possible  values  of  tj  constitutes  the  family  of  finite  dimen¬ 
sional  distributions  associated  with  the  process  (£(t,0))}. 

An  important  question  is  how  far  is  the  probability  distribu¬ 
tion  in  the  sample  space  X  induced  by  a  given  process  determined  by  the 
finite  dimensional  distribution  of  the  process.  An  open  interval  in  X 
is  the  set  of  real-valued  function  x(t),  which  satisfy  a  finite  set  of 
inequalities  of  the  form 

aj  <  X(‘tj')  bj  (j  =  1,2, ...,n) 


b  -  j i 
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where  n  is  an  arbitrary  integer,  tj  e  T,  while  aj  and  bj  are  real, 

finite  or  infinite.  All  finite  unions  of  intervals  form  a  field  Bq  of 

sets  in  X.  Let  B  denote  the  smallest  a-field  containing  Bq.  The  sets 
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of  B  are  called  the  Borel  sets  of  space  X.  The  Kolmogorov  Theorem 
states  that  the  family  of  finite  dimensional  distributions  of  any  given 
stochastic  process  uniquely  defines  the  probability  distribution  in 
the  sample  space  X  for  all  the  Borel  sets  of  the  sample  space  X. 

Further,  given  a  family  of  finite  dimensional  distributions 
with  the  parameter  set  T,  the  necessary  and  sufficient  condition  for 
the  existence  of  a  stochastic  process  associated  with  these  distribu¬ 
tions  is  that  the  given  family  of  distributions  satisfy  the  following 
conditions  of  symmetry  and  consistency: 

(i)  The  symmetry  condition  requires  that  the  nLU  dimensional 

d.f. 


G(x1,...,xn;  tl5...,tn)  =  P{£(ti)  <  xi,...,£(tn)  <  XjJ 

be  symmetric  in  all  pairs  (xj,tj)  for  an  arbitrary  finite  set  of  t 

values  t1,t2,...,t,  so  that  G  remains  invariant  under  any  pairwise 

permutation  of  the  pairs  {x- ,t^}n 

J  J  j  =  i 

(ii)  The  consistency  condition  is  expressed  by  the  relation 


lim 


xn+i » •  •  •  ,xn+k  ^  °° 


G(xi , . . . ,xn, . . . ,xn+k;  ti , . . . ,tn, . . . t  +k) 


G (x !,..., xn ;  t ! , . . • ,tn) 
for  every  pair  of  integers  n  and  k  >  1. 


2-3  Stochastic  Processes  With  a  Continuous  Real  Valued  Parameter 


Let  T  be  the  interval  [o  ,°°)  on  the  real  line  R.  The  probabili- 


. 


•  1  ' 
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ties  of  many  important  events  associated  with  a  continuous  parameter 
stochastic  process,  e.g.  the  probability  that  £(*,0))  is  continuous 
differentiable  or  integrable  on  some  interval  I  =  [a,b]  are  not  unique¬ 
ly  determined  by  the  finite  dimensional  distributions  of  the  process. 
Events  of  this  type  are  not  Borel  sets  because  they  involve  the  beha¬ 
viour  of  E,  on  an  uncountable  set  of  values  of  t.  This  is  a  great  limi¬ 
tation  since  in  applied  situations,  often  something  is  known  about  the 
finite  dimensional  distributions  and  the  objective  is  to  get  maximum 
information  about  the  corresponding  probability  distribution  in  the 
sample  function  space. 

O 

The  concept  of  separability  introduced  by  Doob  imposes  restric¬ 
tions  on  sets  determined  by  an  uncountable  number  of  random  variables 
and  allows  one  to  determine  their  probabilities  uniquely  by  finite  di¬ 
mensional  distributions.  The  stochastic  process 
E,  =  (£(t,00),  t  E  T,  (i)  £  fl} 

is  said  to  be  separable  (relative  to  sets  closed  in  the  sense  of  an 
appropriate  topology  on  X)  if  there  is  a  sequence  S  =  (s^)  of  parameter 
values  and  a  set  N C  ^  of  probability  zero  such  that  for  any  closed 
set  C  in  X  and  any  open  interval  I  on  a  real  line,  sets 

{E, (t ,co)  e  C,  t  e  IT}  C  {^(s^.  ,w)  e  C,  s.  £  IS} 
differ  by  at  most  a  subset  of  N.  The  set  on  the  left  which  is  determin¬ 
ed  by  a  noncountable  number  of  coordinates,  is  assigned  the  same  pro¬ 
bability  as  the  set  on  the  right  which  is  determined  by  a  countable 
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number  of  coordinates.  It  can  be  shown  that  for  any  stochastic  pro¬ 
cess  {£(t,co}  there  exists  a  stochastic  process  {(j0(t,oo)}  defined  on  the 
same  space  fi,  separable  relative  to  the  class  of  closed  sets,  and 


I F  • 
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equivalent  to  (£(t,U))},  that  is 
P(5(t)  =  ^0(t)}  =  1 

for  every  fixed  t  £  T. 

2-4  Gaussian  (or  Normal)  Stochastic  Process 

A  stochastic  process  {£(t,io),  t  £  T}  is  called  Gaussian  if  the 
joint  distribution  of  every  finite  set  of  £t’s  is  Gaussian.  A  general 


Gaussian  process  is  determined  as  follows 


14 


Define  a  projection  operator  Pn  =  P  on  X,  the  linear 

Lj®  ©  ©  l-xi 

space  of  functions  over  T  as 

Pt  =  (x(tj), . .  .  ,x(tn))  ,  tj,...,tn  £  T,  x  £  X. 

Let  Rt^  be  the  family  of  real  lines  (i  =  l,2,„..,n)  and  Bt  be  the 

corresponding  family  of  Borel  sets.  Then  an  n  dimensional  Borel  mea- 

sureable  space  (^pn»®,xn)  is  defined  by  the  Cartesian  product  of  the 

sequence  {R  , B .  }  of  Borel  lines  and  is  given  by 

ci  n 

(firp  .  Brp  )  "  j  j  (R.,.  „  ,  B..  „  )  . 

J-n  J-n  i  1  ci  ci 

1=1 

Clearly  t  plays  only  the  role  of  a  parameter  and 

P  fx(°))  =  (xt  ;  . . .  ;  x  ) . 

t i . . . tn v  J  r i  tn 

The  value  of  xt  depends  on  the  element  x(»)  £  X.  Let  us  introduce  a 
parameter  0  to  explicitly  indicate  this  dependence.  Thus 
pti . . . tn(x^’ ))  =  (xt^(a);  ...;  xtn(a)j 


0  £  Brp  . 

in 

Bt  may  be  generated  by  a  class  CT  of  sets  of  the  form 
n  -Ln 


{CT  k}  =  {, 


•,a„  ;  b 


k 


■n 
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•bnk> 


where 


13. 


where 


Ak  A  {axk, . . . ,ank;  bik, . . . ,bnk} 

=  {a  £  X;  aik  <  £  tKk,  1 , 2 , . . . ,n} . 

B^  is  said  to  be  generated  by  the  class  of  n  dimensioanl  cells  in 


ft 


Tn* 


If  the  linear  space  X  is  known  to  possess  a  complete  orthonormal 
basis  {4>n} ,  the  projection  Pn  can  be  taken  as  the  usual  orthogonal  pro¬ 
jection  of  X  into  its  n  dimensional  subspace.  Then 
?nx ( *  )  =  (<x,c})1>(a)  , .  .  .  ,<x,<J>n>(a))  . 

Let  At  k  be  an  element  of  BT  (the  class  of  Borel  sets  in  ftp  ). 
J-n  in  J-n 

Then  a  Borel  cylinder  is  defined  in  X  by  {AT^k  x  ^TnC^k  f°r  anY  finite 

n  with  At  k  as  the  base.  For  a  fixed  n,  the  cylinder  so  defined  from 
in 

a  G-ring  6^  .  Kolmogorov’s  consistency  relation  demands  that 


(A^  k  x  n  c)  =  p  (At  k) 
in  in  bTn  in 


BT  '  -Ln  xn  DT 

Now  a  stochastic  process  (x(t),  t  E  T}  is  said  to  be  a  Gaussian  pro¬ 
cess  if  for  any  Pn  =  P_  ,  n  <  00 ,  the  vector  Xn  =  (xt-  >  •  •  •  »xt-  ) 

11  1 1 .  .  .  Ln  L  i  Ln 


has  the  probability  density  function 

(  l' 


8  (2n)  =  exp-i-Cx,,  -  ^  Mn  1  (^  -  Ar) 


where 


A„  =  E  x„  =  (ai . a„)  M  is  the  determinant  of  the  matrix  M 

ti  — n  v  1  ’  *  n'  >  1  n 1  n 


and  is  the  n  x  n  positive  definite  moment  matrix7viz. 

E  (xt  ,xt  ) . .  E  (xf  ,xf  ) 

Li  ti  '■n 


Mn  = 


E  (x  ,x  ) 
cn  c  1 


(xt-  >x<-  ) 

Ln  Ln 


Dt3fct,fioo3&  B  wet: 


. 
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It  can  be  shown  that  the  probability  measure  P 

_n 

^  0  1  exp-i-C^  -  An)xMn(2cn  -  An)]dx1 .  .  .dx 


dP 


g  defined  by 

Tn  -i. 

.T, 


/[Mnl 


n 


is  a  countably  additive  measure  function  for  any  finite  n.  Here  the 
sequence  {xn}  may  be  either  {<x,cj)n>}  or  {xt^}  anc^  all  finite  dimension¬ 
al  measure  functions  Pg^  obtained  from  some  suitable  family  of  all 
distributions  define  the  measure  of  all  finite  dimensional  Borel  cylin¬ 
ders  in  X  through  the  Kolmogorov  consistency  relation. 

If  {r](t),  t  £  T}  be  any  stochastic  process  with 
E  {  | nt  |  2 >  <  00 ,  t  e  T, 

then  there  exists  a  corresponding  Gaussian  process  (£(t)}  with  the  same 
parameter  set  but  defined  in  a  different  measure  space,  whose  random 
variables  satisfy 

E  {£t>  =  0 

E  {yTt>  =  E  {Gsnt}  s ,  t  £  T. 

However,  very  few  facts  specifically  true  of  Gaussian  processes  are 
known  and  a  further  structure  has  to  be  put  on  the  stochastic  process 
to  carry  out  the  analysis. 


2-5  Strictly  Stationary  and  Stationary  Gaussian  Processes 

A  stochastic  process  { ^  ( t ) }  is  said  to  be  strictly  stationary 
if  for  any  finite  sequence  of  parameter  points  tj,...,tn,  the  joint 
distribution  of  n  complex  random  variables  ^ (t x  +  T),...,£(t  +  t) 

should  be  independent  of  t.  Thus 

E  £(t)  =  E  £(t  +  t).  2.1 

Without  loss  of  generality  it  can  be  assumed  that  E  £(t)  is  zero. 
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The  covariance  function  of  a  stochastic  process  £  is  defined 
as  r(t,u)  =  E  £(t)£(u)  where  £(u)  is  the  complex  conjugate  of  £(u). 
If  £  is  a  strictly  stationary  process,  then  for  any  t,  u  and  T  e  T 
r(t,u)  =  E  £(t)£(u) 

=  e  at  +  t)5(u  +  t) 

=  E  £(t  -  u)£(0)  (putting  T  =  -u) . 

This  shows  that  r(t,u)  is  a  function  only  of  the  difference  t  -  u. 

The  class  of  all  stochastic  processes  with  finite  second 
moments  satisfying 

E  £j(t)  =  m  (usually  m  is  taken  to  be  zero) 


2.2 


E  5(t)£(u)  =  r(t  -  u) 

is  called  the  class  of  stationary  processes. 

A  stationary  process  will  not  necessarily  be  strictly  station¬ 
ary  because  the  relation  2.2  does  not  imply  the  invariance  of  all  the 
joint  distributions  of  the  variables.  A  strictly  stationary  process 
will  not  satisfy  2.2  since  the  moments  of  the  first  and  second  order 
may  not  exist.  However,  the  class  of  strictly  stationary  processes 
with  finite  second  order  moments  forms  a  subclass  of  all  stationary 
processes.  For  any  Gaussian  process,  all  moments  are  finite.  Thus  a 
strictly  stationary  Gaussian  process  is  always  stationary.  However, 
in  order  that  a  Gaussian  stationary  process  (£(t)}  with  E  £(t)  =  0 
should  be  strictly  stationary,  it  is  necessary  and  sufficient  that  the 
covariance  moment 


q (t , u)  =  E  £(t)£(u) 


formed  without  taking  the  complex  conjugate  of  the  second  factor, 
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should  be  a  function  of  (t  -  u) .  For  a  real  Gaussian  process,  statio- 
narity  and  strict  stationarity  are  equivalent. 

A  notion  of  convergence  of  random  variables  is  necessary  for 
further  discussion.  Suppose  a  sequence  of  random  variables  E>1 , .  . .  ,£  , .  .  . 
is  given,  all  the  =  £n(u))  being  defined  on  the  same  probability 

space.  Let  E,  be  another  random  variable  defined  on  the  same  probabili¬ 
ty  space.  There  are  three  principle  modes  of  convergence  of  to  the 
limit  E,  as  n 

(i)  £n  converges  to  E,  almost  everywhere  (a.e.)  if  P(£n— >*  E.)  =  1. 
a .  e . 

Notation  —  E,n — E,. 

(ii)  E,n  converges  to  E,  in  quadratic  mean  (q.m.)  or  in  the  mean 

q.m, 

square  if  E  |  £n  -  E,\2  ->  0.  Notation  —  — *•  E,. 

(iii)  E,n  converges  to  E,  in  probability  or  in  measure  if  for  every 

pr 

*  >  0,  P  ( |  -  E,\  >  £)  ->  0.  Notation  — -  £n— * 

The  natural  convergence  concept  in  connection  with  processes 

with  finite  second  order  moments  is  convergence  in  quadratic  mean.  If 

cj  ®  m  © 

the  random  variables  £(t)  satisfy  the  condition  £(t)  — ►  £(t0)  as  t  tD , 

then  £(t)  is  said  to  be  continuous  in  the  quadratic  mean  at  t  =  tQ. 

£(t)  is  continuous  in  the  quadratic  mean,  if  and  only  if  the  covariance 
function  r(t,u)  is  continuous  at  the  point  t  =  u  =  t0„  For  any  sta¬ 
tionary  process  (£(t)} 

E  £(t)£(u)  =  r (t  -  u) 

E  £(u)£(t)  =  r (u  -  t) 

so  that  the  covariance  function  satisfies  the  relation 
r(-t)  =  r(t). 

The  variance  is  independent  of  t,  since  for  every  t 


' 


<3  7  «  (3~)7 
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E  |£(t)|2  =  r  (0)  . 

Further 

| r (t) |  <  r(0). 

To  exclude  trivial  cases,  it  is  always  assumed  that  r(0)  >  0.  Hence 
a  stationary  process  £(t)  is  continuous  in  the  q.m.  for  every  t,  if 
and  only  if  r(t)  is  continuous  at  the  point  t  =  0  which  in  turn  also 
implies  that  r(t)  is  continuous  everywhere.  In  the  following  discussion 
it  is  assumed  that  this  continuity  condition  is  always  satisfied  for  a 
stationary  process. 

A  covariance  function  r(t)  of  a  stationary  process  {^(t)}  can 
be  represented  in  the  form 

r  (t )  =  f^V^dGa)  2.3 

— 00 

where  G(A)  is  a  real,  non-decreasing  and  bounded  function.  The  repre¬ 
sentation  2.3  can  be  regarded  as  a  spectral  representation  of  r(t). 

G(A)  is  called  the  spectral  distribution  function  of  the  process  (£(t)} 
and  if  it  is  absolutely  continuous,  the  derivative  g(A)  =  G* (A)  is 
called  the  spectral  density  of  the  process.  For  a  real  stationary  pro¬ 
cess 

r(t)  =  /  cos  AtdG(A). 

It  is  important  to  have  information  about  analytic  properties  like  con- 

1  C 

tinuity  or  differentiability  of  sample  functions.  Dorbushin-1-^  has 
shown  that  a  stationary  Gaussian  process  has,  with  probability  one, 
sample  functions  which  are  either  continuous  everywhere  or  else  have  a 
discontinuity  of  the  second  kind  at  every  point.  Belayev^  showed  that 
if  sample  functions  are  not  continuous,  they  are  unbounded  with  proba¬ 
bility  one  in  any  finite  interval. 
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Hunt^  has  given  sufficient  conditions  for  continuity  of  sample 
functions  in  terms  of  the  spectrum  of  the  stationary  Gaussian  process. 

Let  £(t)  be  a  stationary  process  with  spectral  density  distribution 
G (A) .  If 

|°°[  ln(l  +  A)]adG(A)  <  oo 

for  some  a  >  1,  then  there  is  an  equivalent  process  (n ( t ) }  possessing 
continuous  sample  functions,  with  probability  one.  If  instead  of  the 
above  for  some  a  >  1 

|°°A2[ln(l  +  A)  ]  adG  (A) 

then  there  is  an  equivalent  process  (r|(t)}  which  has  a  continuous  sample 
derivative,  with  probability  one.  Belayev^  translated  the  above  re¬ 
sult  into  a  condition  on  the  covariance  function,  viz.  if  the  covariance 
function  r(t)  of  the  process  (£(t)}  is  such  that 

E  |5(t  +  h)  -  5(t)|2  £  A YYa 

I  In  |  h | |a 

for  some  a  >  1,  C  >  0  and  for  all  suficiently  small  h,  then  there 
exists  an  equivalent  process  {r| ( t ) }  whose  sample  functions  are  continuous 
with  probability  one. 

2-6  Ergodicity 

The  ergodic  hypothesis  provides  a  link  between  the  time  average 
based  on  one  single  realisation  of  the  process  and  the  ensemble  average 
extended  over  the  set  of  all  possible  sample  functions  of  the  process. 

Let  (£(t)}  be  a  given  real  valued  Gaussian  stationary  process 
which  is  always  strictly  stationary.  Consider  the  probability  space 
(X,B,II)  where  X  is  the  space  of  all  real  valued  functions  on  T ,  B  is 


the  smallest  cr-field  over  the  intervals  of  X  and  II  is  the 


II 


19. 


probability  measure  uniquely  determined  on  all  sets  of  B  by  the  finite 

dimensional  distributions  of  £(t).  Now  define  a  shift  transformation 

U^_  in  the  probability  space  taking  u)  =  x(t)  into  a)  =  x(t  -  x) .  The 

transformation  U  for  all  real  x  form  a  group  and  U  ,  =  U.U  .  The 

x  T+p  X  p 

transformations  are  measure  preserving,  because  the  finite  dimen¬ 
sional  distributions  defining  II  are  strictly  stationary. 

Thus  takes  any  set  S  £  B  (of  functions  x(t)}  into  the  set 
formed  by  the  shifted  functions  x(t  +  x)  and  II(S^)  =  II ( S )  for  all 
real  x.  A  Borel  set  S  is  called  an  invariant  set  of  the  process  (£(t)}, 
if  for  every  fixed  x,  the  sets  S  and  ST  differ,  at  most,  by  sets  of  II- 
measure  zero.  The  invariant  sets  form  a  a-field  contained  in  B.  All 
sets  of  probability  II  =  0  and  II  =  1  are  invariant. 

The  strictly  stationary  process  £(t)  is  called  ergodic  (or  me¬ 
trically  transitive)  if  the  G-field  of  invariant  sets  only  contains 
sets  of  probability  zero  or  one. 

Any  random  variable  r|  defined  by  means  of  the  random  variables 
£(t)  for  any  value  of  t  is  called  a  random  variable  defined  on  (£(t)}. 
ri(t)  is  said  to  be  an  invariant  random  variable  of  the  process  {^(t)}, 
if  for  every  fixed  X,  the  random  variables  p  and  Up  are  equivalent. 

Now  assume  that  the  strictly  stationary  process  £(t)  satisfies 
the  two  additional  conditions: 

(i)  E  |£(t)  |  <  00 

(ii)  With  probability  one,  the  sample  functions  of  the  £(t)  pro¬ 
cess  are  Riemann  integrable  on  every  finite  interval.  Then  each  of  the 
time  averages 

if  £(t)dt  and 

-T 


" 
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converges  with  probability  one  to  an  invariant  random  variable  of  the 

£(t)  process,  as  T  ■>  «>.  If,  in  particular,  £j(t)  is  ergodic,  both 

limits  are,  with  probability  one  equal  to  the  constant  E  £(0).  Thus 

lim  i/°5( t)dt  -  E  5(0) 

T-*»  -T 

=  lim  Yi'T^(t)dt. 

T-*»  * 


Here  E  £(0)  is  an  average  value  of  the  random  variable  £(0),  over  the 
set  of  all  possible  sample  functions  of  the  process,  whereas 


T-*»  _t 

values  assumed  in  the  past  by  one  single  realisation  of  the  process. 

When  the  process  £(t)  is  real  valued,  Gaussian  and  stationary, 

and  with  probability  one  its  sample  functions  are  continuous  over  any 

finite  interval;  then  conditions (i)  and  (ii)  are  satisfied  and  so  £^(t) 

1 8 

is  ergodic.  In  terms  of  spectral  representation,  Grenander  has 
shown  that  £(t)  is  ergodic  if  and  only  if  H(A)  =  2G(A)  -  r(0)  is  every¬ 
where  continuous  where  G(A)  is  the  spectral  distribution  of  the  process 

5(t). 


In  applied  situations, 


*«(T) 


lim  -r^J°+T£(t)£(t  +  T)dT 
T-*»  Zi-T 


defined  by 


is  called  the  autocorrelation  function.  Under  the  assumption  of  sta- 
tionarity  and  ergodicity  the  covariance  function 
r  (t)  =  4>^(t). 


2-7  Random  Fixed  Point  Theorems 


The  systematic  study  of  random  equations,  employing  the  methods 


. 
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of  functional  analysis  was  intitiated  by  Spacek  .  The  essential  fea¬ 
ture  lies  in  the  introduction  of  the  notion  of  the  "generalized  random 
variable".  Then  most  of  the  notions  of  functional  analysis  are  carried 
over  into  the  probabilistic  functional  analysis  "in  probability". 

Let  (f2,A,u)  denote  a  complete  probability  measure  space.  Let 
(X,T)  be  a  measureable  space  where  X  is  a  complex,  separable  Banach 
space,  and  B  is  the  a-algebra  of  all  Borel  subsets  of  X. 

A  mapping  x(to)  of  D,  -*  X  is  called  a  generalized  random  variable 
(with  values  in  Banach  space  X)  if 
{co ;  x (co )  e  B}  e  A 
for  all  B  e  T. 

A  mapping  T(to)  of  Cartesian  product  space  x  X  into  a  Banach 
space  Y  is  called  a  random  transformation  if  T(to)[x]  is,  for  x  e  X,  a 
generalized  random  variable  with  values  in  Y. 

A  random  transformation  T  (go)  is  said  to  be 
(i)  linear?  if 

T(w)[ax1  +  3x2]  =  aT(oo)[x1]  +  3T(co)[x2] 
for  every  a)  e  fi,  xl5x2  e  X  and  a, 3  £  R. 

(ii)  bounded,  if  there  exists  a  mapping  c(co)  on  into  R  (i.e. 
c(co)  is  a  real  valued  random  variable)  such  that  for  all  to  e  ^  and 
x  e  X, 

|  |t(oo)x  |  |  <  c(oo)  |  | x  |  |  . 

A  random  transformation  T  (to)  on  x  X  into  X  is  called  a  random 
operator. 

The  mapping  S(oo)  is  said  to  be  the  inverse  of  the  random  opera¬ 


tor  T(to)  if 
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Vi{to;  T (oj)  [ S (co) x ]  =  x  for  every  x  e  X}  =  1. 

The  following  results  are  due  to  Hans‘S. 

(i)  If  xx  (co)  ,x2  (to)  , . .  o  .  is  a  sequence  of  generalized  random 
variables  with  values  in  X  converging  almost  surely  to  a  mapping  x(to) 
of  into  X,  then  x(to)  is  a  generalized  random  variable  with  values  in 
X. 

(ii)  Let  x (to)  be  a  generalized  random  variable  with  values  in  X, 
and  let  T  (co)  be  a  continuous  random  operator  on  11  x  X  to  X,  Then  the 
mapping  y(to)  of  into  X  defined  for  every  to  e  £3  by 
y(co)  =  T  (co)  [x  (to )  ] 

is  a  generalized  random  variable  with  values  in  X. 


Random  Equations 

Consider  the  deterministic  operator  equation 


T[£]  =  y 

where 

£,y  e  X  and  T:  X  -*  X. 


2.5 


Let 

S  =  {x  e  X;  T[x]  =  y}. 

S  is  called  the  solution  set  of  Equation  2.5.  If  S  ^  0,  then  Equation 
2.5  is  said  to  be  solvable  and  if  S  has  only  one  element,  we  say  that 
Equation  2.5  has  a  unique  solution.  Consider  stochastic  analogues  of 
Equation  2.5. 

(i)  y  =y(to)  can  be  a  generalized  random  variable  with  values  in 
X.  In  case  T“1  exists,  then  x(to)  =  T”^  [y  (to)]  will  also  be  a  generali¬ 
zed  random  variable  with  values  in  X. 

(ii)  T  =  T(to)  can  be  a  random  operator  on  ft  x  X  ->  X,  and  y  can 


p 


>  •  )  -  l  J 
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be  a  deterministic  element.  Then 
T(w)  [x]  =  y 

is  called  a  random  operator  equation  and  x(u))  =  T—  ^  (to)  [y ]  will  be,  for 
the  set  of  co's  for  which  T-^(a))  exists,  a  generalized  random  variable 
with  values  in  X. 

(iii)  In  the  most  general  case  T(co)  is  a  random  operator  on  ft  x  x 
to  X  and  y  =  y(co)  is  a  generalized  random  variable  with  values  in  X. 
Hence  Equation  2.5  becomes 

T  (to)  [x]  =  y  (to)  2 . 6 

x  (to)  =  T"1(to)[y(to)]. 

In  this  thesis,,  we  will  be  concerned  only  with  case  (i)  but  the 
following  discussion  holds  good  for  case  (iii)  as  well. 

Every  mapping  x(to)  of  9  into  X  satisfying 
T(to)[x(to)]  =  y(to) 

for  every  to  £  9Qi  where  y(^Q)  =  1 ,  is  said  to  be  a  wide  sense  solution 
of  Equation  2.6.  Every  generalized  random  variable  x(to)  with  values 
in  X  satisfying  the  condition 

y{to;  T (to)  [x (to)  ]  =  y(to)}  =  1 

is  said  to  be  a  random  solution  of  the  random  operator  Equation  2.6. 

In  order  to  study  the  existence,  uniqueness  and  measureability 
of  the  random  solutions  of  random  operator  equations,  use  is  made  of 
probabilistic  analogues  of  the  results  in  the  theory  of  the  determini¬ 
stic  operator  equations.  There  the  principle  of  contraction  mapping 
and  fixed  point  theorems  play  a  very  important  role^l  and  are  briefly 
described  below. 

Let  X  be  an  arbitrary  metric  space  with  distance  function 


. 
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d(x1}x2).  A  mapping  T  of  X  into  itself  is  said  to  be  a  contraction 
mapping  if  there  exists  a  number  c  <  1  such  that  d(Txi,Tx2)  <  cd(xi,X2) 
for  any  two  elements  xl9x2  e  X.  Every  contraction  mapping  defined  on 
a  complete  metric  space  X  has  one  and  only  one  fixed  point. 

Similar ly?  random  operator  T(a))  on  x  X  to  X  is  said  to  be  a 
random  contraction  operator  if  there  exists  a  real  valued  random  vari¬ 
able  c  (co)  such  that  c(oo)  <  1  for  all  u)  e  and  such  that 
|  |  T (to)  [xj  ]  -  T(oo)[x2]  |  |  <  c(oo)  |  |x1  -  x2  |  | 
for  every  u  e  and  for  every  pair  of  generalized  random  variables 
xl5x2  e  X.  If  c(oj)  =  c  <  1  for  all  0)  e  T(u))  is  said  to  be  a  uni¬ 
form  random  contraction  operator.  The  stochastic  analogue  of  Banach 
fixed  point  theorem  due  to  Hans^®  is  as  follows: 

Let  T (to)  be  a  random  contraction  operator  on  x  X  to  X.  Then 
there  exists  a  generalized  random  variable  £(oo)  with  values  in  X  such 
that 

y{o):  T(u>)[£(a))]  =  £(co)}  =  1.  2.7 

The  generalized  random  variable  £(oj)  is  unique  in  the  sense  that  if 
(to)  is  another  generalized  random  variable  satisfying  T^  =  then 
y{a):  5(w)  =  ip(w)}  =  1. 

Further  the  random  fixed  point  £(to)  can  be  obtained  by  successive  appro¬ 
ximations  starting  from  an  arbitrary  generalized  random  variable 
xQ  (co)  e  X. 

2-8  Class  of  Systems  Considered  in  This  Thesis 


We  are  concerned  with  the  random  operator  of  the  type 


' 
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T[x(u)>]  =  y(w) 

where  y(a))  is  a  generalized  random  variable  with  values  in  X.  Further, 
we  are  interested  in  the  situation  where  T  is  a  uniform  contraction 
operator  and  the  domain  of  T  is  the  space  of  stationary  Gaussian  ergo- 
dic  processes  with  finite  second  moments.  The  range  space  is  a  linear 

22  i  i 

complete  metric  space  with  d(£,r|)  =  E  |  E,  -  T]  \  and  becomes  a  Banach 
space  with  norm  |  |  E,  \  \  =  E  |  £  |  ,  provided  the  equivalent  random  variables 
are  identified  to  be  the  same. 


i  n  r  l  :i  ;t=*  83  Jb  £i:  (co) ^  sisrtw 


CHAPTER  III 


ANALYSIS  OF  A  NONLINEAR  FEEDBACK  SYSTEM  WITH  A  SQUARE  NONLINEARITY 


3-1  Introduction 

Consider  the  following  system 

L  (xx )  +  acj)  (xx)  =  y  (t )  3.1 

where  L  is  a  linear,  time  invariant  differential  operator  with  zeros 
only  in  the  left  half  plane,  a  is  a  constant,  (J>  (x  )  is  a  nonlinear 
function  of  and  y(t)  is  the  forcing  function.  Fig.  3.1  is  the  block 
diagram  representation  of  system  3.1. 


Figure  3.1  Figure  3.2 

The  nonlinear  system  can  be  considered  as  a  perturbed  version 
of  the  following  linear  system  (see  Fig.  3.2). 

L(x)  =  y  (t )  3.2 

where  xx  =  x  +  y.  This  is  basically  the  approach  considered  by  Chris¬ 
tensen^,  the  objective  being  to  obtain  a  recursion  relation 

y  =  A(y,y)  3.3 

subject  to  the  constraint  that  A  be  a  contraction  operator.  y(t)  is 
taken  to  be  an  arbitrary,  bounded  driving  function.  Thus  through  the 
use  of  relation  3.3,  a  region  can  be  found  where  system  3.1  gives  a 
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unique  bounded  output  for  each  bounded  input.  In  the  following  discus¬ 
sion,  a  similar  approach  is  formulated  for  the  case  when  y(t)  is  a  sto¬ 
chastic  process  under  suitable  restrictions. 

{ 

3-2  A  Feedback  System  With  Square  Nonlinearity 


Consider  the  system  shown  in  Fig.  3.3, 

L  (Xj)  +  aCx^)  =  y  (t)  3.4 

where  L(p)  is  a  linear,  time-invariant  differential  operator  with  zeros 
only  in  the  left  half  plane  and  y(t)  is  a  sample  function  from  a  real, 

e  =  L(p)xx 


y(t) 


■  g  1 

ON  P  v 

1 

Xi 

L Vp) 

A 

axi2 

or  3 

1 

'Xl 

a(  )2 

=  x  + 


Figure  3.3 

stationary,  ergodic  Gaussian  process.  The  corresponding  unperturbed 
linear  system  is  L(x)  =  y(t).  Let 

x2(t)  =  x  ( t )  +  y(t).  3.5 

A  simplifying  assumption  is  made  that  y(t)  is  also  a  stationary  Gaussi¬ 
an  process.  This  can  be  partially  justified  by  assuming  that  the  input 
process  has  sample  functions  which  are  continuous  everywhere  with  pro¬ 
bability  one.  The  discussion  of  the  results  of  Dorbushin  and  Belayev 
in  Chapter  II  shows  that  this  is  not  an  unduly  restrictive  constraint. 
Hence  xx(t)  is  also  a  stationary,  ergodic  Gaussian  process  and  hence 
so  is  e(t).  Thus  we  are  always  operating  within  the  domain  space  X  of 
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stationary^  ergodic  Gaussian  processes. 

Introduce  a  norm  by  the  relation 

| | x (t ) | |  =  lim  -1/+T |x(t) | dt ,  3.6 

T-*»  Zi-T 

This  relation  must  satisfy  the  axioms  of  the  norm  function  viz. 


(i) 

|  |  x  |  |  > 

0  and  ] | x | |  =  0  if  and  only  if  x  =  0. 

(ii) 

|  |  Ax  |  |  = 

M  1  M  1 

(iii) 

|  x  +  y  | 

<  |  |  x  |  |  +  |  |  y  |  |  . 

Now 

|  x  +  y  | 

|  =  lim  — 4  | x ( t )  +  y (t ) |dt 

T-*»  Zi-T 

<  lim  -1[JT [|x.(t)|  +  |y(t)|]dt] 

T-*>o  Z1  -T 

=  1 lx  1  +  1 |y 1 1 • 

Therefore 

|  x  +  y  | 

<  I  I  x  |  I  +  |  |  y  |  |  . 

Also 

| |Xx(t) | 

=  lim  — |Xx(t)  | dt 

T-k»  2T_-p 

=  |  X  |  lim  — J+T  |  x(t)  |  dt 

1  1  yryj  1  v  /  1 

T-x»  Z"L—  x 

=  |  X  |  |  |  x  (t )  |  1  - 

The 

defining 

relation 

implies  | | x | 

1 |x(t)| | 

||  =  0  if 

1  r+T  |  , 

=  lim  Yfj  |  x(t)  1  dt 

p-Hxi  —p 

and  only  if  x  =  0.  Hence  the  relation  defined  by 

3.6  satisfies  the  axioms  of  the  norm. 


Consider  the  operator  equation  L(x)  =  y(t),  or 


x(t)  =  3  (y) 

=  |°°h(t  -  T)y(x)dT 

where  h(t)  is  the  impulse  response  of  the  operator  3  and  h(t)  = 
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Youla  has  shown  that  a  necessary  and  sufficient  condition  that  a 


-i  1 


L(p) 


bounded  input  to  a  linear,  time  invariant  system  gives  rise  to  a  bounded 
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output  is  that 


Let 


|  | h(t)  |  dt  <  00 . 


foo .  . 

[  | h(t) | dt  =  H. 

In  the  representation  shown  in  Fig.  3.4,  y  (t)  is  the  input  to  3 
and  the  output  is  yQ(t).  3  can  be  considered  to  be  a  linear  operator 


y0(t> 

— * — 


Figure  3.4 


mapping  the  Banach  space  X  into  itself. 
yc(t)  =  B(yi(t)) 

P  00 

=  I  h(t  -  T)yi(T)dl 

| |yG(t) | |  <  | | 3y± | | 

=  lim  7“  |+T| /°°h(t  -  T)yi(T)dT|dt 
X-^oo  z±  -X  D 

<  lim—  J+T[f  |  h  (t  -  T)  |  |yi(T)  |  dx]  dt. 

X-xo  2T  _!£  v 

Interchanging  the  order  of  integration 

|  |y  (t)  j  |  £  f°°(lim  "ok  /+T|Mt  -  t)  |  |yi(x)  | dt] dx 
^  x-x»  -T 

=  f°°|h(x)  |  (lim  2^  I+T|yi(t  -  x)  |  dt)  dx 

*  X-x°  —X 

=  |°°|h(x)  |  dx  |  | y±  |  | 

=  H| |y±I | - 

Hence  3  is  a  linear  bounded  operator  and  so  is  continuous. 

An  operator  A  mapping  an  arbitrary  metric  space  (Z,p)  into  it- 

2  5 

self  is  said  to  be  a  contraction  operator  if  for  every  xlsx2  in  Z, 


p(Ax1,Ax2)  <  KpCxjjXg) 
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where  K  is  a  constant  0  <  K  <  1 . 

Further,  given  a  sphere  S  of  radius  y  in  a  Banach  space  X  about 

xQ  (that  is  | |x  -  xG| |  <  y)  and  an  operator  A  mapping  S  into  X  such 

that 

| |Axj  -  Ax2 ||  <  K | | Xj  -  x2 | | 

for  any  pair  of  points  xlsx2  of  S,  where  0  <  K  <  1,  then  the  operator 
equation  Ax  =  x  has  a  unique  solution  x*  in  S 

x*  =  xG  +  (Xj  -  xQ)  +  ...  +  (xn  -  x^_  )  +  .  .  . 

where 

xi  =  Axq 

xn  -  Axn-i 

provided  the  following  fixed  point  condition  is  satisfied 
|  |  Axq  -  xQ  |  |  <  y  ( 1  -  K)  o 

For  the  system  3.4,  x*  is  obtained  by  Volterra  series  through 
an  iteration  proceedure.  Thus,  a  convergence  criterion  is  formulated 
for  the  Volterra  series  so  obtained,  based  on  the  contraction  mapping 
principle.  This  approach  is  essentially  that  of  Christensen^? . 
Referring  to  Fig.  3.3, 
e  =  y  -  axj 2 . 

But  x2  =  $e,  Therefore 

e  =  y  -  a($e)2 

e2  =  y2  -  2oty(3e)2  +  a2(|3e)4. 

Putting  e2  =  z,  one  gets 

z  =  y2  -  2ay (3/z) 2  +  a2(3/iV 


=  A(z,y) . 


3.7 
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For  the  contraction  condition  to  hold, 

|  |A(z x ,y)  -  A(z2,y) |  |  <  k|  |z}  -  z2 |  |  where  0  <  K  <  1 

that  is 

|  |y2  -  2ay($/z7)2  +a2($v/z7)4  -  y2  +  2ay(3/z7)2  _  o:2  (3/z^) 4  |  | 

<  Kl  1Z!  "  Z2  I  I 

or 

|  |-2ay(3vz7  -  $/2~)  ($/z^  +  $/i~)  +  a2  ('3^zj"  -  B/zJ)  (B^z7  +  B/z~)  0  [(3/iTV 

+  (B/F2)2]i| 

<  k|  |  (/r*  -  (/^  +  >^7)  1 1 

or 

|  |  B2 1  |  ||  -  /z2  ||  ||  v^7  +  |  |  |  {az  [  (B/z/) 2  +  (Bv^V  ]  -  2ay}  |  | 

<  K|  |/Zi  -  /z2  |  |  |  \7z[  +  ^2  I  I 
or 

|  |B2|  I  {a2  I  |(B^7)2  +  C6v^7>2  |  !  +  2|a|  |  |y|'|  }  <  K. 

Now  let 

I  |y  1 1  -  y 

Nell  -  h 

so,  we  get 

a2H2 1  |  (B/T7>2  +  (3>47)2 1  I  <  K  -  2  |a|H2Y 
or 

a2H4[  |  |^7|  |2  +  |  |iz7|  |2]  <  K  -  2  |a | H2Ye 

Let 

I  I z I  I  >  I  lzi I  I 


Then 


a2H42 | |z I  I  <  K  -  2 |a | H2Y 


or 


. 
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Hence 


cb  < 
Yee 


K  -  2  Nh  Y 
-  2a2H4 

.  .  _Ir+T  2j 
=  lim  2tJ  e  at 

T-x»  Z  -T 

=  <J> 

ee 


K  -  2|a|H  Y 

2a2H4 


3.8 


Taking  the  first  approximation  zQ  =  0,  for  the  fixed  point  con¬ 
dition  to  be  satisfied, 

| | A(zQ ,y)  -  zQ | |  <  (1  -  K) | | z | | 


or 


<  (1  -  K)  z 


or 


cf)yy  <  (1  -  K)(f) 
<  (1  -  K)[J 


ee 
K  -  2 


a 


2 

H  Y 


2a  H 


] 


3.9 


It  is  to  be  noted  that  Equation  3.9  includes  both  the  contraction  and 
the  fixed  point  conditions,  and  puts  a  constraint  on  the  autocorrela¬ 
tion  d)  of  the  input. 

yy 

Now  considering  Equation  3.7 

z  =  y2  -  2ay($v/z")2  +  a2(3v/z")4 
1st  approximation 

z0  =  ° 

2nd  approximation 

zi  =  y2 

3rd  approximation 


z2  =  y2  -  2ay (3y)2  +  a2(3y)4 


and  so  on 


=  zQ  +  (zj  -  zQ)  +  (z2  -  z  )  +  ...  +  (zn  -  z^p  +  ... 


3.10 


'  .  ■  ■  ' 
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Provided  Equation  3.9  is  satisfied,  the  iteration  series  given  by  Equa¬ 
tion  3.10  will  converge  to  the  solution  of  Equation  3.7. 

Another  way  to  analyse  the  system  3.4  is  by  the  following  method 
y (t )  -  ax*2  =  —  x 

3  1 

or 


xi  =  3y  -  oi^Xt  2 


or 


x  +  y  =  3y  -  a3(x  +  y)2 


or 

3y  +  y  =  3y  -  a3(3y  +  y)2 
y  =  -a3(3y  +  y)2 

A  A(y,y)  3.11 

where 

A(y ,y)  =  -a3(3y  +  y)2. 

Taking 

ho  =  0 

y i  =  -a3(3y)2 

y2  =  -a3(3y  -  a3(3y)2)2 


etc . ,  and 

y  =  yD  +  (]i1  -  yQ)  +  (y2  -  y2)  +  . . .  +  (yn  -  yn-1)  +  ...  3.12 
it  follows  that  the  series  3.12  convereges  to  the  solution  of  3.11  if 
contraction  and  fixed  point  conditions  are  satisfied.  For  the  contrac¬ 
tion  condition  to  hold 

|  | A (y !  ,y)  -  A(y 2  ,y)  |  |  <  k|  \]i1  -  y2  |  |  where  0  <  K  <  1 


Therefore 
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|  | -ot3(3y  +  y.)2  +  ag(3y  +  y2)2 1  |  <  k|  |vix  -  y2  |  [ 

or 

|a|  | |3| |  || (3y  +  u2)2  -  (3y  +  V1)2\ I  <  k| |y x  -  y2|  | 
or 

H  |  |  g|  |  life  -  V,] [(By  +  y2)  +  (gy  +  U,)]||  <  k| |y,  -  y2 | | 
or 

2 jot |  1 13|  |[|  1 3y |  |  +  |  |y 1 1]  <  k 

because 

I  lull  >  llu, 1 1 

and 

iiuii  >  iiu.ii. 

Now,  let 

llell  -  H 

i|y||  -  y 

Null  =  u 

llx,ll  -  X,. 

Therefore  we  get 


For  the  fixed  point  condition  to  hold 

|  |  A(li0  ,y)  -y0||  <  (1  -  K)  |  |y|  |  . 
Since  y0  has  been  taken  to  be  zero 

l|A(u0,y)||  <  (1  -  K) I  lull 
| |-ag(6y)2 | |  <  (1  -  K)||u|| 


or 


-a3(3y) 


lot  |H 
1  -  K 


1  -  K 

3 


< 


1 1  y 2 1 1  <  u 


bl-fi  ;>3  noioibno:  dni oq  boxit  srib  ioi 

,  |  jq|  |  (x  -  i)  >  I  !0u  -  (y.to^>Al  I 

C1.-3S  3d  03  n -Oil bJ  fiascf  £orf  0U  soni<2 

Iiif||<a  -  >  '>  i  U't. 0->Ai 
i  |  ,j;  ju  -  o  '  ils(ta>aio- 


10 


I  1  M  I  I  )i  -  1 


o  >  IIMI 


Ilk. 

a  -  i 
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or 


or 


M  2  1 

1  -  K 

K 

1  |y  I 

'"it* 

-  [a |H3 

■  ",  -  HY 

2  |  a  |  H 

<j>  <  (1 

yy  - 


-  K) 


K 


HY 


9  h 

20t  H 


a  H  i 


-  (1  -  K) 


K  -  2 |a }H  Y 

2a2H4 


3. 13 


Equations  3.9  and  3.13  give  identical  constraints  on  the  auto¬ 
correlation  (j)  of  the  input.  However,  the  first  approach  is  convenient 
only  for  the  case  when  the  nonlinearity  in  the  feedback  loop  is  of  the 
"square"  type  and  fails  to  work  in  the  case  of  "cubic"  nonlinearity. 

In  such  a  case,  the  second  approach  can  be  utilized  but  it  is  diffi¬ 
cult  to  get  a  bound  on  the  input  correlation  function. 


i  •  .  C  i 


CHAPTER  IV 


ANALYSIS  OF  PHASE  LOCKED  LOOPS 


4-1  Introduction 


Phase  locked  loop  systems  are  playing  an  increasingly  impor¬ 
tant  role  in  modern  communication  and  tracking  systems.  Phase  lock 
demodulation  is  widely  used  for  reception  of  signals  in  the  presence 
of  noise,  the  major  advantage  being  that  demodulation  can  take  place  at 
lower  signal  power  levels  than  by  more  conventional  means.  Recently 
Kulman  and  Stratonovich  have  shown  that  under  certain  restrictions, 
automatic  frequency  phase  control  (AFPC)  is  the  optimal  device  for  re¬ 
ceiving  stochastic  signals  with  fluctuating  background  noise. . 


4-2  Physical  Behaviour  and  Description  of  the  Loop 


A  phase  locked  loop  contains  three  basic  components: 

(i)  A  phase  detector  (PD) . 

(ii)  A  low  pass  filter. 

(iii)  A  voltage  controlled  oscillator  (VCO) ,  whose  frequency  is 


controlled  by  an  external  voltage. 


Voltage 

controlled  oscillator 


Figure  4 . 1 
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The  phase  detector  makes  a  comparison  between  the  phase  of  the  input 
and  the  phase  of  the  VCO.  The  output  of  the  PD  is  a  function  of  the 
phase  difference  between  its  two  inputs  and  acts  as  the  error  signal  in 
the  feedback  loop  shown  in  Fig.  4.1.  The  error  signal  is  filtered  by 
the  loop  filter  and  acts  as  a  control  signal  for  the  VCO.  It  tends  to 
cause  a  frequency  change  of  the  VCO  so  as  to  reduce  the  phase  difference 
between  the  input  and  the  local  oscillator.  When  the  loop  is  synchro¬ 
nized  or  "locked",  the  control  signal  is  such  that  the  frequency  of  the 
VCO  is  equal  to  the  average  frequency  of  the  input,  thereby  implying 
that  for  each  input  cycle  there  exists  a  unique  cycle  of  the  output. 

This  is  the  basis  of  application  of  the  phase  lock  in  automatic  fre- 
29 

quency  control  . 

The  use  of  phase  lock  loops  in  demodulation  can  be  understood 
by  considering  that  the  input  carries  the  information  in  its  phase  or 
frequency.  Invariably  additive  noises  are  present.  The  local  oscilla¬ 
tor  frequency  is  adjusted  close  to  that  expected  in  the  input  signal. 

The  output  of  the  phase  detector  gives  instantaneous  phase  difference. 
Noise  proofing  is  obtained  by  averaging  the  error  over  a  finite  length 
of  time.  The  averaged  error  controls  the  frequency  of  VCO.  If  the 
input  is  stable  in  frequency,  the  VCO  requires  only  a  small  amount  of 
information  to  perform  tracking.  Thus  the  phase  locked  loop  can  be 
considered  as  a  type  of  filter  that  passes  signals  and  rejects  noise  . 
The  pertinent  characteristics  of  the  filter  are  a  very  narrow  band 
width  and  automatic  tracking  of  the  input  signal.  The  narrow  band 
width  is  responsible  for  rejection  of  large  amounts  of  noise  thereby 
providing  a  high  degree  of  noise  proofing  . 
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4-3  Various  Mathematical  Analytical  Approaches 

The  phase  locked  loop  is  a  nonlinear  system  with  lag.  Several 

techniques  have  been  evolved  for  analysing  phase  locked  loop  behaviour. 

Early  techniques  were  based  on  linear  models.  Jaffe  and  Rechtin^ 

developed  a  linearised  model  for  optimum  design  based  on  Wiener  filter- 

ing  theory.  Develet  modified  this  to  a  quasi-linear  model  using  the 

Booton  quasi-linearisation  model^.  A  correct  nonlinear  model  was  deve- 

32 

loped  by  Van  Trees  .  The  model  is  a  nonlinear,  randomly  time  varying 

system  and  is  not  amenable  to  analysis.  Subsequent  work  has  been  based 

on  the  simplified  model  of  phase  locked  loops  suggested  by  Develet^l. 

33 

Margolis  has  given  an  analysis  based  on  the  perturbation  method.  Van 
Trees'54  used  a  Volterra  series  representation  to  predict  loop  perfor¬ 
mance. 

In  all  the  above  methods,  the  design  philosophy  has  basically 
been  oriented  to  develop  a  theory  which  specifies  the  variance  of  the 
phase  error  as  a  function  of  the  signal  to  noise  ratio  existing  in  the 
band  width  of  the  loop.  The  results  obtained  are  approximately  correct 
for  large  input  signal  to  noise  ratios  but  begin  to  fail  near  the  thre¬ 
shold. 

Another  analytic  approach  used  to  develop  an  exact  nonlinear 
theory  of  phase  locked  loops  is  based  on  the  Fokker-Planck  method. 
Viterbi"^  and  Tikhonov^  have  given  exact  results  for  steady  state 
performance  of  the  first  order  loops.  The  central  idea  underlying  the 
approach  is  that  for  systems  which  are  described  by  first  order  diffe¬ 
rential  equations  whose  forcing  term  is  a  white  Gaussian  noise,  the 
output  is  a  simple  Markov  process.  The  behaviour  of  the  system  can 
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then  be  described  by  either  the  backward  Kolmogorov  equation  or  the 
Fokker-Planck  equation  .  The  main  disadvantage  of  this  approach  is 
that  analysis  can  be  carried  out  only  for  a  first  order  loop  without 
the  loop  filter  included  in  the  feedback  circuit.  For  loops  with  fil¬ 
ters  one  cannot  solve  the  resulting  differential  equations.  Even  for 
the  simplest  case,  the  calculations  are  tedious  and  cumbersome. 

In  the  following  discussion  an  anlysis  of  the  first  order 
phase  lock  loop  is  presented  based  on  solving  the  dynamic  loop  equa¬ 
tion  using  functional  techniques,  specifically  Volterra  functional 
expansion  technique.  Basically  it  consists  of  the  application  of  a  per- 
turbation  technique^  .  But  the  analysis  differs  from  Van  Trees'3 
approach  in  not  using  the  multidimensional  Laplace  transform  technique 
and  breaking  the  system  into  multidimensional  kernels.  The  results 
obtained  give  a  better  estimate  of  the  variance  of  the  phase  error  near 
the  threshold  region  for  the  low  signal  to  noise  ratio. 


4-4  Simplified  Mathematical  Model 


31 

The  model  considered  in  Fig.  4.2  is  one  suggested  by  Develet  . 
Input  Loop 


Figure  4.2 
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Let  the  input  signal  in  Fig.  4.1  be  /2Asin [u)Q  (t )  +0!]  where  0  x  ( t )  can 
be  a  random  process.  Assume  that  the  received  noise  n(t)  is  a  sample 
function  from  a  stationary  white,  narrow  band  Gaussian  process  of 
one-sided  spectral  density  NQ  watts/hertz.  Assume  the  phase  locked 
loop  is  preceeded  by  a  band  pass  filter  with  centre  frequency  fQ  and 
a  band  width  W  which  is  very  wide  compared  to  the  frequency  region  of 


interest.  W  <  2f0.  If  W  =  2fQ,  the  band  pass  filter  becomes  a  low  pass 
filter.  Expand  the  given  stationary  Gaussian  process  n(t)  over  an  arbi¬ 
trary  interval  0  <  t  <  T  by  the  Fourier  series.  Thus 

00 

n(t)  =  I  ncmcos  ma^t  +  ngmsin  mu^t 
m=! 


where 


and 


ncm  =  |  cos  "“l1  dt 


o  T 

nsm  =  t  I  n(‘t^  Sln  dt' 

It  can  be  shown  that  the  coefficients  ncm  and  ngm  are 

Gaussian  random  variables  which  are  uncorrelated  as  the  duration  of  the 


OO 

expansion  interval  increases  without  limit  .  Introduce  the  mean  fre¬ 
quency  of  the  spectral  band  by  writing 
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mo^  =  (nuoj  -  oo  )  +  ooq 

where 


00  =  2TTf  . 

o  O 

Define 


n  (t)  =  -=  £  .  [n  cos  (mlo,  -  co_)t  +  n  sin  (mco.  -  oo  )t] 
c  /2  m=i  cm  1  °  sm  1  o 

and 

1  00 

n  (t)  =  -r=  £  [n  m  sin  (moo,  -  oo  )t  +  n__  cos  (moo,  -  oo  It], 
s  v 2  m= i  cm  1  o'  sm  o/J 


Then 


fl  n  (t)  cos  oo.t  -  /2  n  sin  oo_,  t 
c  °  s  ° 


=  ncm[cos  (mooi  -  ooQ)t  cos  ooQt  -  sin  ooQt  sin  (mooj  -  ooQ)t] 
00 

+  £=1  ngm[sin  (moo x  -  ooQ)t  cos  ooQt  +  cos  (moo1  -  ooQ)t  sin  ooQt] 


00  00 

=  £  ,  n  cos  moo.t  +  £  n  sin  moo,t  =  n(t). 
m=i  cm  ir  m=i  sm  i 

Thus 

n(t)  =  /2  nc(t)  cos  ooDt  -  ng(t)  sin  wQt. 

The  above  decomposition  for  a  narrow  band  stationary  Gaussian  process 

on 

has  the  following  properties  : 

(i)  Spectra  of  nc(t)  and  ng(t)  are  low  pass  in  nature. 

(ii)  n(t )  =  0  =^nc  =  ng  =  0. 

(iii)  n(t)  Gaussian  n  and  n  are  also  Gaussian. 

c  s 

(iv)  n2(t)  =  nc2(t)  =  ng^ (t). 

(v)  n  and  n  are  independent,  that  is,  n  (t)n  (t)  =  n  (t)  •  n  (t) . 
Thus  n  (t)  and  n  (t)  can  be  regarded  essentially  as  independent 

L.  S  1 

white  Gaussian  processes  of  one  sided  spectral  density  N  watts/hertz. 

The  output  of  the  Voltage  Controlled  Oscillator  (VCO)  in 


. 
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Fig.  4.1  is  a  sinusoid  whose  frequency  is  controlled  by  the  input 
voltage  z(t), 

e2(t)  =  -  v(t) 

so  that  when  z(t)  =  0,  the  VCO  frequency  is  ajQ.  Hence  the  VCO  output  is 
/2  K  cos  [u)0t  +  6  2  ( t )  ]  o 

Assume  that  the  phase  detector  is  a  multiplier.  Therefore, 
the  product  of  the  input  and  the  reference  signal  is 

2 (A  sin  [0)o(t)  +  01(t)]  +  nc(t)  cos  ttQt  -  ng(t)  sin  0)ot} 

*  {K2  cos  [u)Qt  +  0 2  ( t)  ]  } 

=  K2{A  sin  [0j(t)  -  02(t)]  +  nc(t)  cos  02(t)  +  ng(t)  sin  02(t) 
+  A  sin  [2u)0t  +  ©jCt)  +  02(t)]  +  nc(t)  cos  [2w0t  +  0  2  (t )  ] 

-  ns(t)  sin  [2u)Qt  +  02  (t)]}. 

The  double  frequency  terms  can  be  neglected  since  neither  the  filter 
nor  the  VCO  would  respond  to  these  for  large  u) .  Therefore, 

z(t)  =  K2F(s)  {A  sin  [  0  j  (t )  -  02(t)]  +  nc(t)  cos  02(t) 

+  ns (t)  sin  02  (t ) } 

where  F(s)  is  a  rational  function  which  represents,  in  operational  no- 
tation,  the  effect  of  a  linear  filter  in  the  loop  . 

Let  E(t)  =  © 2 ( t )  -  02(t)  denote  the  instantaneous  phase  error. 
Therefore 

o  ® 

E (t )  -  ex  (t)  -  KlZ(t) 

=  0 x (t)  -  KjK2F(s)  [A  sin  E(t)  +  N(t)] 

where 
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N(t)  =  nc(t)  cos  02(t)  +  ng(t)  sin  02(t). 

Let  KjK2  =  K.  Then 

E(t)  =  0 ! ( t )  -  [A  sin  E(t)  +  N(t)]F(s)— .  4.1 

s 

The  differential  equation  4.1  in  operational  form  represents 
the  dynamic  operation  of  the  phase  locked  loop  with  the  block  diagram 
given  in  Fig.  4.2.  Viterbi^  has  shown  that  N(t)  is  a  stationary  pro¬ 
cess  with  exactly  the  same  statistics  as  nc(t)  and  ng(t).  Hence  N(t) 
is  a  Gaussian  white  process  at  least  over  the  frequency  range  up  to 
0)o  rad/sec  with  one  sided  spectral  density  NQ  watts/hertz. 

4-5  Analysis  of  First  Order  Loop 


When  considering  the  first  order  loop,  F(s)  =  1  and  the  phase 
locked  loop  model  reduces  to  Fig.  4.4. 

N(t) 


Equation  4.1  becomes 

4^  +  KA  sin  E (t )  =  0.  (t)  -  KN (t) 
dt  1 

=  x ( t )  4.2 

where  x(t)  can  be  considered  as  an  equivalent  input.  Assume  0 x  (t )  =  0. 
N(t)  is  a  sample  function  from  a  white  Gaussian  process  with  zero  mean 
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and  correlation  function 

Rn(t)  =  N(t)N(t  -  T) 

-  ^  fi[t  -  (t  -  T)] 

-  |2.  S(T). 

Equation  4.2  can  be  written  as 

E  +  KAE  +  KA  sin  E  -  KAE  =  x(t) 


or 


L (E)  +  KA  sin  E  -  KAE  =  x(t) 


where  L  is  the  linear  differential  operator  (s  +  KA) . 

Let  $  be  the  corresponding  integral  operator,  that  is 
$(x)  =  |  h(t  -  T)x(x)dT 

and 


h(t)  -^‘t+Sea  -  e_KAt 

is  the  impulse  response  of  the  operator  3.  Therefore 
E  =  gx  +  gKAE  -  gKA  sin  E 


4.3 


=  g(x  +  KAE  -  KA  sin  E)  =  y(E,x) 

Equation  4.3  is  the  nonlinear  equation  in  the  integral  operator  form 
to  be  analysed  by  Volterra  series. 

Let  the  first  approximation  be 


E0  =  $x. 

Second  approximation 

Ej  =  g(x  +  KAEq  -  KA  sin  E0) 

etc. 


4.4 


4.5 


The  solution  of  Equation  4.3,  E*  can  be  written  as 

E*  =  E0  +  (Ex  -  E0)  +  ...  +  (En  -  E^j )  +  ...  4.6 


provided  the  series  4.6  converges.  In  Equation  4.6,  E*  is  obtained 


■ 


■V 

U)x  «  ,v  n.  a  1  +  r.A‘  -f  . 
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by  Volterra  series  generated  through  an  iteration  proceedure.  A  con¬ 
vergence  criterion  is  now  formulated  for  the  Volterra  series  so  obtain¬ 
ed,  based  on  the  contraction  mapping  principle.  This  approach  has 
been  discussed  in  Chapter  III. 

Consider  the  nonlinear  operator  Equation  4.3 
E  =  3[x  +  KAE  -  KA  sin  E] 

=  li[E,x]  . 


For  y  to  be  a  contraction  operator, 

| |y(E2,x)  -  y(E1 ,x) I  I  <  y| |e2  -  Ej 
where  Y  is  a  constant,  0  <  Y  <  1. 


l.  e. 


$(x  +  KAE 2  -  KA  sin  E2)  -  (3(x  +  KAEj  -  KA  sin  Ex) 


<  Y  Eo  -  Ei 


x.  e. 


KA |  I  3  I  I  j|E2-sinE2-E1+  sin  E  x |  |  <  Y |  | E2  -  E  x |  j „ 

Expanding  sin  E2  and  sin  Ex  in  power  series,  we  get 

3  5  7 

E2  -  E:  +  sin  Ex  -  sin  E2  =  [  -  ^ _  +  Ej - +  . .  .1 

L  3!  5!  7!  J 


5: 

3 


-  bft-  +  lh-lh  + 


..  ] 


Since  E2  -  Ex  is  a  common  factor  to  all  the  terms,  we  get 


E2  -  Ei  +  sin  Ei  -  sin  E2  =  (E2  -  Ej)^ 


E22  +  E1E2.+  Er 


3! 


 E24  +  E23El  +  E22El2  +  E2E13 
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+  •••]. 


ir3||E||2  5 1 

|  E  | 

|e2  -  E:  +  sin  Ex  -  sin  E2 | 

< 

| | E2  “  Ei| 

d  3!  + 

5! 

+  El4 


Hehce 


.1  ~  .  .  f<T  1  ;  •  ■  i ' ;  ')  - -i  ’  ' 


■  ■- 


. 
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or 


or 


+  7.|  |  E  |  |  6  *  *  •  J 

7!  J‘ 


=  | |E2  -  EX 


II 

r 

E] 

2 

X 

ieit 

L 

2' 

4! 

ALL  +  •  •  •] 

6!  J 

=  | |e2  -  Ei | | [cosh  | | E | |  -  1] 
Therefore  the  contraction  condition  is  satisfied  if 
KA| I  el  I [cosh  I |e| I  -  l] I |e2  -  Ej| I  *  I |e2  -  Ej I |y 


cosh  E  <  1  + 


ka| |g| | 


E|1  -  cosh'1[1  +  KAifeTT1 


For  the  fixed  point  condition  to  be  satisified 
|  |ji(Eo)  -  E0|  |  <  (1  -  Y)(|  |E|  |). 


We  have 

Eq  =  3x. 

Therefore 

]i(E0)  =  $[x  +  KAEq  -  KA  sin  EQ] 
=  3[x  +  KA3x  -  KA  sin  3x] 

and 

y (E0)  -  Eq  =  KA3(3x  -  sin  3x) . 

Hence 


|KA3(3x  -  sin  3x) | |  <  ( 1  —  Y) | | E | | 


or 


KA||e||[||M|  +  I  I  sin  6x  |  |  ]  <  (1  -  Y)  |  |E 
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But 

| sin  y | |  <  |  | y | |  . 

Therefore  for  the  fixed  point  condition  to  be  satisfied 
KA I  I  3 II  2  I  I 3x|  I  <  (1  -  Y) I  I E I  I 


or 


where 


x 


1  ~  Y 

2KAH 


I |$| |  =  H. 

Now  consider  the  second  approximation 

Ej  =  3(x  +  KAEC  -  KA  sin  E0) 

The  object  of  interest  is  <  Ei2  > 

■p  3  p  5 

sin  E0  =  E0  -  +  ”  * 


4.7 


4.5 


Substituting  this  value  in  Equation  4.5 

Ex  =  3[x  +  KAE0  -  KAEC  +  Ka|^- 
Considering  S1-*1  power  terms  in  EQ  only 
Ej  =  3tx  +  KA-^y—  -  KA.fH 


-  KA|2-  +  *  *  *  ] 
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=  3x  +  ka3-|9~  -  ka3^9— 


=  eo  +  KA3§^-  -  ka3§9-. 


Therefore 


KA, 


<  E,'  >  =  <  E0'  >  +  <  2  •  fKgE03)(E0)  >  + 


<  -2K^(  Eq  )(E0)  >  +  <  -^^2(gE03)(gE05)  > 

+  <  5^32(E0)6  >  +  <  |!A1b2(E0)10  > 

^  ^  •  J.  J. 
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where 


=  (a)  +  (b)  +  (c)  +  (d)  +  (e)  +  (f). 

r\ 

Consider  the  expression  4.8a  viz.  <  EQ  > 

E0(t)  =  gx 

'=  -gKN(t) 

.00 

=  -  f  h(T)KN(t  -  T)dT 

h(i)  =  e-KAT,  T  >  0 

=0,  T  <  0. 


Therefore 


o  o  .00  r°°  —  KAT  i  —KAT  r, 

<E0 2  (t ) >  =  K2/  /  e  1  *  e  2<N(t  -  T x  )N(t  - 


<N(t  -  T  !  )N(t  -  T 2 ) >  =  lim  T^/+TN(t  -  T !  )N  (t 

T-X30  Zi_T 


put 


then 


t  "  Tj  =  Y 


dt  =  -dy 

and  the  limits  of  integration  are 


and 


Therefore 


Y  =  T  -  Ti 


y  =  -T  -  TP 


i  T— T 

<N(t  -  Tj)N(t  -  T 2 ) >  =  lim  — /  1  N(y)N(y  +  t 


T-k»  2T_.j_^- 


The  correlation  function  of  N(t)  is  defined  by 

V 


Rn(t)  =  lim  -i/+TN(t)N(t  +  T ) dt 
T-H»  Zi-T 


=  ^6(T). 
2 


4.8 


T2)>dTidT2 

T2)dt 


1  -  T  2  )  dy . 


‘  •  ! 


r)  . 


■ 
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Therefore 


and 


<N(t  -  Tx)N(t  -  T2)>  =  -  T2) 


<E  2> 


=  K2ffe~ KA-r>.e-KAT2|a6(Ti  .  Tj)dXldT2 

=  £!lk  ie-KATl|VKAT26(Ti  _  T2)dT2 


K2Nn  r”,„  -KAT 1 .  -KAT 1 


M 


dll  e 


2  .  -1' 

K2Nnre-2KAT>l” 


•  e 


-2KA 


KNc 

4A 


=  Z 

The  parameter  Z  plays  an  important  role 

z  .  No  (f } 

(A)  2 


4.9 


In  the  linearised  model  of  Fig.  4.4,  the  sinusoidal  nonlinearity  is 


replaced  by  its  gain  A  about  E  =  0  and  <E2>  =  thereby  implying 

the  variance  of  E  is  the  same  as  the  noise  power  at  the  output  of  an 

KA 

ideal  low  pass  filter  of  bandwidth  —  when  the  input  is  white  noise  of 

one  sided  spectral  density  Nq.  Hence  for  the  first  order  loop,  loop 

bandwidth  BT  =  and  Z  =  Mk  But  A2  is  the  received  signal  power. 

L  4  (A)2 

1  A2 

Therefore  —  =  -  ■  is  the  signal  to  noise  ratio  (SNR)  in  the  bandwidth 

z  wo“L 

O  Q 

of  the  loop'1  . 

Now  consider  expression  4.8b  viz. 
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<|tKA(6e0)3e0> 


P(E0)3  =  fh(Ti)E03(t  -  T ,  )dx  j 


r''  ' 


.  '  ■  ■  ■ 


i  s  •  j. 


o 


. 

...  , 


-  'i 


■ 

A  ax; 

. 

/ 

■  -  -  '  1  •*.  ■  ' 
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where 


Hence 


Therefore 


0° 

EQ(t)  =  |  h(T)x(t  -  T)dT. 

0(EO)3  =  |°°dir(  dTi{  dT2|°0dT3h(T)h(T1)h(T2)h(T3)  • 

X(t  -  T  -  T  x )  X  ( t  -  T  -  x2)x(t  -  T  -  T3)  . 


<6(eo)3eo>  =  <3(Eo)3^x> 

roo  roo  r oo  roo  roo 

=  l  l  l  l  l  dTdTldT2dT3dT1+h(T)h(T1)h(T2)h(T3)h(T4)  * 

<  X  ( t  -  T4)x(t  -  T  -  T  j  )x  (t  -  T  -  T  2  )x  ( t  -  T  -  T3)> 

4.10 


Consider  n  normal  real  random  variables  xx ,x2 , . . . »xn«  Let 

—  —  39 

z.  =  x.  -  x.,  where  x.  =  mean  value  of  x.  Then  it  can  be  shown  that 
3  J  3’  3  m 


E{z1 , . .  .  ,z2m)  £  (~[T  z-jzk  ) 

all  pairs  j^k 


=  E  {<z  .z,  ><z1  z  >.  .  .<z  zg>}  j^k,  l^p,  etc 

i  i  •  J  -L  r  a 

all  pairs 


and 


E{z i , z2 » • . . , z 2m+i )  -  0. 

Now  the  number  of  such  averages  over  pairs  is  equal  to  the 
number  of  different  ways  2m  different  variables  zi,...,z2m  can  be 

O  Q  O-rn  * 

chosen  in  pairs,  which  isjy  — . 

2 m.m! 

In  Equation  4.10  there  are  four  random  variables  so  that  m  =  2. 

A  * 

Hence  there  are  2  ■  t  =  3  ways  into  which 

2  •  2 . 

<x(t  -  T4)x(t  -  T  -  T  x  >X  (t  -  T  -  T  2  )x  ( t  -  T  -  T3)> 
factors  into  the  product  of  two  terms  taken  at  a  time. 


* 


.  -  ■ 1  " 


3)  x  (  j;  r  ■  i 


...  -  ■'  . 


■ 


' 


■ 


“  T  -  3  y.ift  ■  3)  {> 
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Therefore 


<x(t  -  T4)x(t  -  T  -  Tj)x(t  -  T  -  T2)x(t  -  T  -  T  3 )> 

=  <x(t  -  T4)x(t  -  T  -  Tj)><x(t  -  T  -  X2)x(t  -  T  -  T3)> 

+  <x(t  -  T  -  Tj)x(t  -  T  -  T  2 ) ><X ( t  -  T  -  T  3 ) X (t  -  X4) 

+  <x(t  -  T4)x(t  -  T  -  X2)><x(t  -  X  -  Xj)x(t  -  X  -  X3)> 

6(x4  -  x  -  x1)6(x  +  x2  -  x  -  x3)  + 

+  6(Xj  -  x2)6(x  +  x3  -  x4)  +  6(Xj  -  x 3 )  (x  +  x2  -  x4) 


K4(^a) 

2 


2  r 


J4.ll 

Let  us  evaluate  the  contribution  of  the  first  term  of  Equation 


4.11  to  Equation  4.10. 

,00  ,oo  ,oo  ,0O  ,00 


i  l  {  l  I  dTdTi • • •dT4h(x)h(x1 ) . . .h(x4)6 (x4  -  x  -  x1)6(x2  -  x3)  = 


■  4  • 


fOO  f  CO  fCO 

111  h(x4  -  xi)h(x1)h(x2)h(x2)h(x4)dx1dx2dx1 

Similarly 

rrrrrdTdTi*  “dT4h^T)h(Ti>*  *  *h(x4)^(Ti  ~  t2^^t  +  Ta 


4.12 


-  X4) 


-00  -CO  -CO 

=  J  J  J  h(x3  -  x4)h(x2)h(x2)h(x3)h(x4)dx2dx3dx4 


4.13 


=  |  |  |  h(x3  -  x1)h(x2)h(x2)h(x3)h(x1')dx2dx3dx1 

(because  x2  and  X4  are  symmetric) 

=  ^CO|°°h(T4  ~  x1)h(x1)h(x2)h(x2)h(x4)dx1dx2dx4. 

(interchanging  X4  and  X3  because  of  symmetry) 

Equations  4.12  and  4.13  are  identical.  Similarly  by  the  use  of  symme¬ 
try  of  arguments  the  contribution  of  the  third  term  of  Equation  4.11  to 
Equation  4.10  is  identical  to  the  other  two  terms.  Therefore 
<B(E0)3E0>  =  3K*(|2.)2|”^“|”|”h(T)h(T1)h(t2)h(T3)h(T4)6(T4  -  X  -  T,) 

6 (x 2  -  X3)  •  dxdx 1dx2dx3dx4 


! 


'  •  ■ 

3  '  '  ' 

+  (;  T  -  T  -  -f  b(i7  -  T  -  47)cjV(x  i)^  - 
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=  3K4(NQ.)2|00|00|00|00h(T)h(T1)h(T3)h(T3)h(T4)6(T4  -  T  -  T^dTdTj... 


dx4 


I  TVT  o  /-OO  -CO  -OO  _ 

=  3K4(^-)2|  |  j  h(T)h(x1)h2  (T3)h(T  +  Ti)dTdT1dT3 
=  3K4  (|Q-)2|0°|0°h(T)h(T1)h(T  +  e_2KAT3dT3 

=  3k4(^)2-1-  rre-2mT  + 

2  2KA  t)  i  1 


Hence 


=  3K4(^.)2(-J-)3. 
2  2KA 


<  §t*A((3E0)3E0>  = 


3K3(^)2(^)3 


=  lfKNn>2 

2V4A  ' 


=  !z2 
2Z  • 

Now  consider  expression  4.8c,  <  -2^(3EQ) 5 (EQ)  > 

5 . 


where 


Therefore 


3  (E0)  5  =  |°°h(T  1  )EQ  5  (t  -  T  x ) dT  2 

OO 

E0(t)  =  J  h(T)x(t  -  T)dT. 


4.14 


c  /“OO  /»00 

3(E0)5  =  |  dT  J . .  . |  dT6h(T1)...h(T6)x(t  -  Tj  -  T2)x(t  -  T1  -  T  3 ) 
X ( t  "  TX  -  T4)x(t  "  Tj  -  T  5)x (t  -  Tx  -  T6). 

Therefore 

c  ,oo  c°° 

<3(E0)5Eq>  =  f  ...]  dxdTj. . .dT6h(T)h(T1). . .h(T6)  * 

<x(t  -  x)x(t  -  Xj  -  x2)x(t  -  Xj  -  x3) 

X  ( t  -  T1  -  X4)  ‘  X ( t  -  Xj  -  X  5 )x (t  -  T1  -  X6)>. 

4.17 


In  Equation  4.17,  there  are  six  Gaussian  random  variables.  Therefore 


T  ■ 


'  s ’■  "  •8-’  -  •  5<  Vi  1  '  as  U  i;  f:  .  >u  f  ,W.A  no  a 


6  * 

the  number  of  factors  is  — g — =  15.  Making  use  of  the  symmetry  of 

2  *  3  • 

arguments  as  done  while  evaluating  the  expression  4.8b,  one  obtains  that 
all  the  15  terms  are  the  sameJ  .  Hence 
3(Eq)5Eo>  =  |°°.  .  .^dTdTi .  .  .dTsh(T)h(T1) .  .  .h(T6)  x  15{<x(t  -  T) 

X ( t  -  T1  -  T 2 )><X (t  -  Tl  -  T3)x(t  -  T1  -  T4)>  * 

<x(t  -  Tl  -  T  5>X (t  “  Tl  -  T6)>} 


< 


=  15K6  (|cl)  3|°°.  .  .^“dTdTj .  .  .dx6h(T)h(T1) .  .  .h(TG)  *  6  (t  -  -  t 

6(t3  -  t4)  (t5  -  t6) 

=  15K6  C”2")  3^°°.  •  •  |°°h(T !  +  T2)h(T4)h(x6)  •  h(T1)h(T2)h(T4)h(T6) 
dTidT2dTLfdT6 

=  15K6  3|00^00|00|00e_2KA^T  1  +  T2  +  T4  +  T6)dT1dT2dT4dT6 

■  15K6(la)3(m>4 

Therefore 

<-  Tt(eEo5)Eo>  ■  Wf 


|(^)3 


=  -  —z3 

8 L  ' 


Now 


,K2A2o2w  6. 


4.18 


consider  expression  4.8d,  viz.  < - p  E  > 

3!  3!  0 

<32eq6>  =  <3E03  *  3eo3> 

=  |°°. .  .|0°dT1dT2.  .  .dTgdT^TphCTj)  .  .  .h(x6) 


h(T  )h(Tg)  *  <x(t  -  Ta  -  T  i  )x  ( t  -  Ta  -  T2) 
CL 


X ( t  -  Ta  -  T 3  )  *  x(t  -  T  -  T 4 ) X ( t  -  T  -  T5 ) 


X ( t  -  Tg  -  T6)>. 


4.19 


Sixth  order  moments  factors  giving  15  terms. 

Utilizing  the  symmetry  of  argument  and  the  properties  of  6 
34 


function  one  gets 


' 


54. 


<x(t  "  Ta  ‘  Ti)x(t  -  Ta  "  t2)x(c  '  Ta  '  V  '  x(t  "  Tg  ~  Vx(t  ~  Tg  '  V 

x(t  -  T3  -  t6)  = 


K 


6  (No.)  3 


96(T1  -  T2)6(Ta  +  T3  -  tr  -  T4)6(T5  -  t 6 )  +  66 (t„  +  tx  -  tr  -  x4) 


e 


a 


6(t  +  T0  -  T  -  T  )  •  6(t  +  T  -  T  -  T  ) 


a 

Therefore 


a 


^  -OO  -OO  -CO  -OO 


6 


e 

4.20 


<32e  6>  =  k6(^)3 

o  2 


|  |  |  dT1...dT6dTadTgh(T1)h(T2)...h(T6)h(Tct) 

h(Tg)  •  {96(T!  -  T2)6(Ta  +  t3  -  Tg  -  t4)  • 

6(t5  -  t6)  +  65(xa  +  Tx  -  Tg  -  t4)  * 

^  —  x  _  ^  •  tK  f  T 


6<T„  +  T2  -  Tr  -  T5>  '  «(Ta  +  T3  -  Tg  -  X6)} 


a 


4.21 


=  K6(Na)3 
2 


9{  (f h2  (Tj)dTj  2j”h(T3)dT3|"h(Ta)dTai(“h(TB)dTe 


h(T^  +  T3  -  Tr)u(t  +  T3  -  TQ ) }  + 


a 

l*OQ 


3' 


6{^  h(Ta)dTa|°°h(Tg)dT^0Oh(T1)dT1|COh(T2)dT2|  h(T3)dT3  * 

h(Ta  -  t3  +  Ti)u(Ta  -  T3  +  Ti}  *  h(Ta  ~  T3  +  T2}  ' 
u(Ta  “  T3  +  T2)  *  h(T-  ~  T«  +  -  tr  +  t3)} 


a  3 


a  L3 


4.22 


|°°h2(T1)dT1  2  =  |°°e  2KATidT1 


1 


TTT 


4K  A 


Consider 


moo 

h(Ta)h(TB)h(T3)h(Ta  +  T3  -  Tg)U(Ta  +  T3  -  TB)dTadTgdT3  = 

fdV(VfdV<Vfh<Vh<Ta  +  T3  -  Vu(T<*  +  T3  -  VdV  4’23 

Let  Ta  +  T3  -  T3  ~  ^ 

Then 

rOO  r00 

I  h(Tg)h(Ta  +  T3  -  Tg)u(Ta  +  t3  -  Tg)dTg  =  -J  h(Oh(Ta  +  T,  -  5  )  • 

Ta+T3 

u(5)d(5) 


■ 


•i  ,T  -  T  -  *  T)3 


•:  ■ "  1 .  •  ■  ]  ■  ■  \  ■  ■ 


{(aT  “  aJ  "  sT  4  *  &  "  ST  -  s'  4*  _ 


r  !?■*  '  (  ■  '■  -  »  '  >  ,  ’  - 


■  j ) ■*-'  '  -  v  •  (  J-  + 


o  co* 


v  rs 


nsffT 
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=  /Ta+T3h(5)h(T0  +  t3  -  O  ■ 

—00 

u(£)d£.  4.24 

Whenever  E,  <  0,  the  integrand  in  4.24  is  zero.  Hence 

|  h(Tg)h(Ta  +  T3  -  Tg)u(Ta  +  T3  -  Xg)dXg  =  |Ta+T3h(£)h(Ta  +  T3  -  £)d£ 

=  |Ta+T3e-KA^e-KA(Ta+T3-^)d^ 
-KATa-KAT 

=  e  a  3(ta  +  t3). 

Hence  the  first  term  in  [  ]  bracket  in  Equation  4.22  reduces  to 

1  e-2KAT3 


4K 


9  .  2rV2KA%dT„fT3e-2KAndT3  =  — 9-r  •  -J-[t3(- 

^4  “4  3  4K2A2  2KAL  3  2KA 

+  J^'2^3  '  ldT3] 


9 


[  — T3  _  1  e-2KAT3^°° 


4K 3A 3  2KAe+2KAT  3 

_9 _  .  1 

4K3A3  4K2A2 


4K2A2 


16K5A5  * 


4.25 


Now  consider 

-00  -00 

|  ...|  dTidT2. . .dT6dTadTgh(Ti)h(T2)h(T3)h(T4)h(T5)h(T6)h(Ta)h(Tg)  ' 


6(Ta  +  Tl  -  Tg  -  T4)6(Ta  +  x2  -  T3  -  T5)6(Ta  +  T3  -  Tg  -  T6) 


■  r-_nT^ .r--“T,sf 


00  -KAT 1  .  r00  -KAX2j,.  r°°--KAX3 


e  -  -dT,fe-^^dT2(  . 


■dTj  e  1N"tadx,  •  e 


-KA(xa-T3+Tl) 


u(xa  -  Xg  +  xx)  •  e  KA^T°t  T3+T2^u(Ta  -  Tg  +  X2)  •  e  KA('Ta  t3+t3) 


u(xa  -  x3  +  x3) 

=  p-4^dxaP+2^T3dx3|°°e-2KAT2u(xa  -  xg  +  x2)dx2  •  pr2KAT3 
u(Ta  '  TB  +  T3>dT2re'2KATlu<Ta  -  Tg  +  Ti)dTi  = 


'  ■  1  f  .J.  r  ;  . 

i  -  ■  -  *  4  "■  j 


. 


|  e_^KATadTa|0°e+2KAT3dT^  |0°e-2KATu(Ta  —  +  x)di  .  4.26 

Consider  the  term  [/(...) dx ] 3  in  Equation  4.26.  For 
T  +  Ta  -  Tg  <  0  the  integrand  is  zero.  Hence  T  >  -  Ta  for  the  inte¬ 

gral  to  exist.  Also  T,  Ta,  Tg  >  0.  There  are  two  situations  to  consi¬ 
der. 

"'3 


a 


Figure  4.5 


(i)  Tg  >  Ta.  This  corresponds  to  region  A.  In  this  case,  the 
limits  of  integration  are 

TB  -  Ta  <  T  <  ” 

0  •=  Ta  <  TB 

0  <  Tg  <  00 . 

(ii)  Ta  >  Tg.  This  corresponds  to  region  B  and  T  is  always 
greater  than  Tg  -  Ta.  Therefore  the  limits  of  integration  are 
0  <  t  <  00 


0  <  t  <  00 

a 


0  <  To  <  T  . 


3  a 

Hence  the  integral  in  Equation  4.26  reduces  to 
|»e+2KATSdT  rTge-4KATadTo  fjoo  e-2KATdT-|3  +  p^KAT^^Ta^KATg^ 


^S'Ta 


|7“e-2KATdTJ 


4.27 


The  first  term  on  the  right  hand  side  of  Equation  4.27 
=  (^)3|“|Tg[e-6KA(xe-Ta)]e2KATe  .  e-4KATadTBdTo 


-  (2k>re"4KAT6dTePe2KTadl 


a 


=  (-J_)3-J-re-4KATgdtB[e2KATB  -  1] 

2KA  2KA*  P 


■  2kat ^  -  re_4KATto  3] 


(— “  i 1 


1 


2KA  2KA  4KA 


] 


1  (_ L_) 5. 

2  2KA 


The  second  term  on  the  right  hand  side  of  Equation  4.27 
1  n3  .  /  1  xf°°r-2KTn  n„-4KTr 


=  (_L_) 3  •  (  1  )rreZKTa  -  lle"4KTadT 
4ka;  Le  iJe  aTa 


=  —  (  ) 5 
2  2KA  * 


Therefore  expression  4.26 

=  2  •  —  (— ^)5 
2  4KA; 


=  5 
l2KA;  ’ 


and  it  follows 


<32eo6> 


_  v-6  /Nn  \  3  r  9  1  6  I 

(2  '  16K5A5  2 5K5A5 


=  k(Nq.)  3  *  -JL 

2  4A5 


<|^2eo6> 


k2a2 


rNo  3  3 


35"  • 


1  /KNq \ 3 

7  (4a  - ) 


whence 


! 


A2£ 


•'  ... 


■j  ?  .  £  nc  r  -  950-7:;  r 


C  2 


'  , 
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FIGURE  4.6 
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J_Z 3 

6 


4.28 


To  get  an  expression  for  <EX2>  in  terms  of  the  third  power  of 
Z  only,  the  terms  4.8d  and  4.8f  can  be  neglected  because  they  give 


rise  to  terms  involving  IT  .  Therefore 

,KA 


<E !  z>  =  <E0Z>  +  <2^8(E0)dE0>  +  <-2|4(3E0')(Eo)> 


+  <K.?.A2_g2E  6> 

31 3!  ° 


-  z  +  y  -iz3  +  ^ 


7  4-  Jl7  2  +  .1 _ 7  3 

2  +  24Z  * 


4.29 


Equation  4.29  is  plotted  in  Fig.  4.6  and  a  comparison  is  made 

between  the  results  obtained  by  various  methods.  A  noteworthy  feature 

of  Equation  4.29  which  has  been  obtained  by  the  Volterra  functional 

series  approach  through  the  iteration  proceedure,  is  the  close  agree- 

q 

ment  between  the  exact  results  obtained  by  Tikhonov  through  the  Fokker- 
Planck  equation  and  the  Markov  process  approach.  The  results  agree 
even  at  low  signal  to  noise  ratios  in  which  region  the  other  methods 
fail  to  give  reliable  results. 
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CHAPTER  V 


CONCLUSIONS  AND  REMARKS 


An  approach  invoking  probabilistic  functional  analysis  has  been 
used  for  the  analysis  of  nonlinear  feedback  systems  with  random  inputs. 
A  number  of  restrictions  on  the  stochastic  input  (e.g.  stat ionarity , 
ergodicity,  normality)  have  been  put  to  obtain  results.  The  general 
framework  of  the  problem  is:  if  the  input  y(co,t)  is  a  given  stochastic 
process  and  T(oj)  a  random  operator,  what  type  of  stochastic  process 
(x(co,t),  t  £  0}  is  generated  by  the  solution  x(co,t)  =  T~  1  (to )  [ y  (oo ,  t ) ]  ? 
This  is  a  field  of  active  mathematical  research^  whose  results  can  be 
usefully  applied  to  engineering  problems. 

An  assumption  has  been  made  throughout  that  the  input  signal 
to  the  nonlinear  element  is  Gaussian.  But  the  distortion  terms  (which 
have  non-Gaussian  amplitude  distribution)  are  correlated  with  the  input 
signal  to  the  system.  This  point  has  been  discussed  by  Smith^  where 
he  states  that  in  case  results  based  on  this  assumption  differ  conside¬ 
rably  from  those  obtained  by  quasi-linearisation,  the  analysis  acts  as 
a  confidence  test  for  a  quasi-linear  method,  rather  than  as  a  method 
yielding  higher  accuracy. 

The  analysis  of  Chapter  IV  has  indicated  the  usefulness  of  the 
approach  in  the  case  of  the  phase-locked  loop  systems.  A  first  order 
loop  without  the  low  pass  filter  in  the  loop  circuit  was  considered. 

A  problem  of  great  practical  significance  is  the  extension  of  the 
method  to  the  case  where  the  loop  filter  is  also  included  in  the  phase- 
locked  loop.  Two  widely  used  loop  filters  are  the  following.  The 


. 
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Rx  R2  C 


Passive  Filter  Active  Filter 


Figure  5 . 1 


passive  filter  is  often  satisfactory  for  many  purposes  whereas  the 

active  filter  provides  better  tracking  performance.  Instances  of  the 

use  of  a  filter  with  transfer  function  (sT2  +  ^  ^ST4  +  and  its 

(sTj  +  1)(st2  +  1) 

variants  also  exist  in  the  literature^. 
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APPENDIX  I 


VAN  TREES  APPROACH* 


Consider  the  differential  equation 

+  K  sin  E  =  0 !  (t )  -  KN(t ) 
dt 

=  x(t).  1 


Suppose 

00 

E (t)  =  Z  E  .  (t)  2 

1=1  1 

where  Ex  is  the  output  of  the  linear  system  h1(x1),  E2  is  the  output 
of  the  second  order  system  h2(Xi,x2)  and  so  on.  Substitute  2  into  1 
and  sort  the  terms  according  to  the  order  in  which  they  involve  x(t). 

Expand  sin  E(t)  also.  Therefore 

•  •  • 

[Ej(t)  +  E2(t)  +  E3(t)  +..]  +  K[(E1(t)  +  E2(t)  +  E3(t)  +  ...) 

-  —(El  (t)  +  E2  (t)  +  E3  (t)  +  .  .  . ) 3  +  ^-p(Ei  (t)  +  E2  (t)  +  . . )  -  . . .  j5] 

=  x(t)  .  3 

Equate  terms  of  equal  order  in  x(t) 

Ei(t)  +  KEj(t)  =  x ( t ) .  4 


All  terms  in  4  are  first  order  in  x(t) 

E2(t)  +  KE2(t)  =0  5 

E3  (t )  +  KE3  (t)  =  ~-E  1  3  (t )  6 

J  • 

E4(t)  +  KEi+  (t)  =  ^-3E12(t)E2(t) 

3  • 

=  |Ei2(t)E2(t).  7 

E5  (t )  +  KE5  (t )  =  |E12(t)E3(t)  -  “-Ej  5  (t)  8 

The  equations  4  to  8  can  be  solved  sequentially. 

Ex(t)  =  j  e“KTx(t  -  T ) dx 

-CO 

=  f  h!(x)x(t  -  x)dx  9 


*  Reference  34. 
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where  we  define 

h(x)  =  e_KT  x  >  0 

=  0  t  <  0 


10 


Clearly 

E2(t)  =  o  11 

because  the  terms  on  the  left  hand  side  of  Equation  5  do  not  involve 
the  forcing  function.  Consequently  all  higher  order  even  terms  are 
zero . 


E3(t)  =  ^hj  (T1>|7E13(t  -  T)dT. 
Substitute  9  into  12.  This  gives 

(•oo  _  COO  _  coo  _  c°°  -  ,  K 


12 


E3  (t )  =  |  dT |°°dT  j |°°dT 2 1  dT3  [|Th1  (x)h1  (T1)h1  (x2)h1  (t3) 

x(t  -  x  -  xx)  *  x ( t  -  x  -  x2)x(t  -  x  -  x3)].  13 

Thus  it  is  easy  to  see  that  E3  depends  in  a  third  order  manner  on  x(t). 


Similarly 

E  5  (t )  =  |°°h1  (x)  [^E1 2  (t  -  T)E3(t  -  X)  -  -jp-E^Ct  -  x)dx].  14 
Expressing  in  terms  of  x(t)  only,  we  have 

Vo  roo  roo  -oo 

E5(t)  =  |  dx  dx2 . .  .  |  dx7[h1(x1)h1(x2)...h1(x7) 

X  ( t  -  XI  -  X2 )  •  X ( t  -  Xj  -  X  3  >X ( t  -  Tj  -  X4  -  X  5 ) 

•  x ( t  -  Xj  -  x4  -  x6)x(t  -  Xj  -  x4  -  x7) 

tt  -00  -00  -CO 

-  dTlj  dT2...j  dx6h1(x1)...h1(x6)  • 

•  x ( t  -  Xj  -  x2)x(t  -  Xj  -  x3)x(t  -  Ti  -  x4) 

•  X  (  t  -  Xj  -  X  5  )  X  (  t  -  Xj  "  Xg).  15 

Once  again,  the  fifth  order  relationship  between  E5(t)  and  x(t) 

is  clear.  Van  Trees  assumes  the  series  in  Equation  2  converges  without 


any  proof.  In  the  analysis  presented  in  Chapter  IV,  we  give  a  conver¬ 


gence  proof. 
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Consider  the  approximate  solution 

E  (t)  =  Ej(t)  +  E3(t)  +  E5  (t )  .  16 

d 

Assume 

9 1 (t)  =  0. 

Let  N(t)  be  a  sample  function  from  a  white  Gaussian  process  with  corre¬ 
lation  function 

%(T)  =  |g26(T).  17 

We  want  to  evaluate  the  variance  of  E„(t).  To  evaluate 

d 

o 

<Ea  (t)>  consider  the  double  sum 

<Ea2(t)>  =  Zi  Zj  <EiEj> 

1,2,3  1,2,3 

A  fundamental  quantity  in  the  solution  is 

K Nn  =  z 

4A2 

which  physically  represents  noise  to  signal  ratio.  The  terms  of  inte¬ 
rest  in  Equation  18  are  <Ei2(t)>,  <EX (t )E3 (t )> ,  <E32(t)>  and 
<Ei (t )E5 (t)>. 

Evaluation  of  <Ei2(t)>.  This  is  simply  the  linear  approximation 

<Ei2(t)>  =  K2|°°|00h1  (T^hj  (T2)<N(t  -  Tj)N(t  -  T2)>dT1dx2 

=  K2|00|00e"KTl_KT2(^r)6(T1  -  T2)dT1dT2 

-  k2 

=  Mo. 

4a7* 

=  Z.  19 

Van  Trees  Evaluation  of  the  Other  Terms 

(i)  <E  i 2  (t )  >  =  Z 

(ii)  <E1(t)E3(t)>  =  i-Z2 

(iii)  <E32  (t)>  =  -^Z  3 

(iv)  <Ei(t)Es(t)>  =  -7Z3. 


X  .  ■  >.  <  ■>  ‘  i  '  i  ■  1 
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2 

One  can  show  that  terms  of  <E3(t)E5(t)>  and  <E5  (t)>  are  fourth  order 
in  Z.  Consider  terms  involving  third  order  in  Z  only.  From  Equation 
18  we  get 


<Ea2(t)>  =  <EX  2 (t )>  +  2<E1(t)E3(t)>  +  <E32(t)> 

+  2<E1(t)Es(t)> 

=  z  +  — z 2  +  13z 3 

2  24 

Equation  20  is  plotted  in  Fig.  4.6  to  give  a  comparison  between  the 
results  obtained  in  the  thesis. 
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